mirror of
https://github.com/ivuorinen/f2b.git
synced 2026-01-26 11:24:00 +00:00
* Go rewrite * chore(cr): apply suggestions Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Signed-off-by: Ismo Vuorinen <ismo@ivuorinen.net> * 📝 CodeRabbit Chat: Add NoOpClient to fail2ban and initialize when skip flag is true * 📝 CodeRabbit Chat: Fix malformed if-else structure and add no-op client for skip-only commands * 📝 CodeRabbit Chat: Fix malformed if-else structure and add no-op client for skip-only commands * fix(main): correct no-op branch syntax (#10) * chore(gitignore): ignore env and binary files (#11) * chore(config): remove indent_size for go files (#12) * feat(cli): inject version via ldflags (#13) * fix(security): validate filter parameter to prevent path traversal (#15) * chore(repo): anchor ignore for build artifacts (#16) * chore(ci): use golangci-lint action (#17) * feat(fail2ban): expose GetLogDir (#19) * test(cmd): improve IP mock validation (#20) * chore(ci): update golanglint * fix(ci): golanglint * fix(ci): correct args indentation in pr-lint workflow (#21) * fix(ci): avoid duplicate releases (#22) * refactor(fail2ban): remove test check from OSRunner (#23) * refactor(fail2ban): make log and filter dirs configurable (#24) * fix(ci): create single release per tag (#14) Signed-off-by: Ismo Vuorinen <ismo@ivuorinen.net> * chore(dev): add codex setup script (#27) * chore(lint): enable staticcheck (#26) * chore(ci): verify golangci config (#28) * refactor(cmd): centralize env config (#29) * chore(dev): add pre-commit config (#30) * fix(ci): disable cgo in cross compile (#31) * fix(ci): fail on formatting issues (#32) * feat(cmd): add context to logs watch (#33) * chore: fixes, roadmap, claude.md, linting * chore: fixes, linting * fix(ci): gh actions update, fixes and tweaks * chore: use reviewdog actionlint * chore: use wow-rp-addons/actions-editorconfig-check * chore: combine agent instructions, add comments, fixes * chore: linting, fixes, go revive * chore(deps): update pre-commit hooks * chore: bump go to 1.21, pin workflows * fix: install tools in lint.yml * fix: sudo timeout * fix: service command injection * fix: memory exhaustion with large logs * fix: enhanced path traversal and file security vulns * fix: race conditions * fix: context support * chore: simplify fail2ban/ code * feat: major refactoring with GoReleaser integration and code consolidation - Add GoReleaser configuration for automated multi-platform releases - Support for Linux, macOS, Windows, and BSD builds - Docker images, Homebrew tap, and Linux packages (.deb, .rpm, .apk) - GitHub Actions workflow for release automation - Consolidate duplicate code and improve architecture - Extract common command helpers to cmd/helpers.go (~230 lines) - Remove duplicate MockClient implementation from tests (~250 lines) - Create context wrapper helpers in fail2ban/context_helpers.go - Standardize error messages in fail2ban/errors.go - Enhance validation and security - Add proper IP address validation with fail2ban.ValidateIP - Fix path traversal and command injection vulnerabilities - Improve thread-safety in MockClient with consistent ordering - Optimize documentation - Reduce CLAUDE.md from 190 to 81 lines (57% reduction) - Reduce TODO.md from 633 to 93 lines (85% reduction) - Move README.md to root directory with installation instructions - Improve test reliability - Fix race conditions and test flakiness - Add sorting to ensure deterministic test output - Enhance MockClient with configurable behavior * feat: comprehensive code quality improvements and documentation reorganization This commit represents a major overhaul of code quality, documentation structure, and development tooling: **Documentation & Structure:** - Move CODE_OF_CONDUCT.md from .github to root directory - Reorganize documentation with dedicated docs/ directory - Create comprehensive architecture, security, and testing documentation - Update all references and cross-links for new documentation structure **Code Quality & Linting:** - Add 120-character line length limit across all files via EditorConfig - Enable comprehensive linting with golines, lll, usetesting, gosec, and revive - Fix all 86 revive linter issues (unused parameters, missing export comments) - Resolve security issues (file permissions 0644 → 0600, gosec warnings) - Replace deprecated os.Setenv with t.Setenv in all tests - Configure golangci-lint with auto-fix capabilities and formatter integration **Development Tooling:** - Enhance pre-commit configuration with additional hooks and formatters - Update GoReleaser configuration with improved YAML formatting - Improve GitHub workflows and issue templates for CLI-specific context - Add comprehensive Makefile with proper dependency checking **Testing & Security:** - Standardize mock patterns and context wrapper implementations - Enhance error handling with centralized error constants - Improve concurrent access testing for thread safety * perf: implement major performance optimizations with comprehensive test coverage This commit introduces three significant performance improvements along with complete linting compliance and robust test coverage: **Performance Optimizations:** 1. **Time Parsing Cache (8.6x improvement)** - Add TimeParsingCache with sync.Map for caching parsed times - Implement object pooling for string builders to reduce allocations - Create optimized BanRecordParser with pooled string slices 2. **Gzip Detection Consolidation (55x improvement)** - Consolidate ~100 lines of duplicate gzip detection logic - Fast-path extension checking before magic byte detection - Unified GzipDetector with comprehensive file handling utilities 3. **Parallel Processing (2.5-5.0x improvement)** - Generic WorkerPool implementation for concurrent operations - Smart fallback to sequential processing for single operations - Context-aware cancellation support for long-running tasks - Applied to ban/unban operations across multiple jails **New Files Added:** - fail2ban/time_parser.go: Cached time parsing with global instances - fail2ban/ban_record_parser.go: Optimized ban record parsing - fail2ban/gzip_detection.go: Unified gzip handling utilities - fail2ban/parallel_processing.go: Generic parallel processing framework - cmd/parallel_operations.go: Command-level parallel operation support **Code Quality & Linting:** - Resolve all golangci-lint issues (0 remaining) - Add proper #nosec annotations for legitimate file operations - Implement sentinel errors replacing nil/nil anti-pattern - Fix context parameter handling and error checking **Comprehensive Test Coverage:** - 500+ lines of new tests with benchmarks validating all improvements - Concurrent access testing for thread safety - Edge case handling and error condition testing - Performance benchmarks demonstrating measured improvements **Modified Files:** - fail2ban/fail2ban.go: Integration with new optimized parsers - fail2ban/logs.go: Use consolidated gzip detection (-91 lines) - cmd/ban.go & cmd/unban.go: Add conditional parallel processing * test: comprehensive test infrastructure overhaul with real test data Major improvements to test code quality and organization: • Added comprehensive test data infrastructure with 6 anonymized log files • Extracted common test helpers reducing ~200 lines to ~50 reusable functions • Enhanced ban record parser tests with real production log patterns • Improved gzip detection tests with actual compressed test data • Added integration tests for full log processing and concurrent operations • Updated .gitignore to allow testdata log files while excluding others • Updated TODO.md to reflect completed test infrastructure improvements * fix: comprehensive security hardening and critical bug fixes Security Enhancements: - Add command injection protection with allowlist validation for all external commands - Add security documentation to gzip functions warning about path traversal risks - Complete TODO.md security audit - all critical vulnerabilities addressed Bug Fixes: - Fix negative index access vulnerability in parallel operations (prevent panic) - Fix parsing inconsistency between BannedIn and BannedInWithContext functions - Fix nil error handling in concurrent log reading tests - Fix benchmark error simulation to measure actual performance vs error paths Implementation Details: - Add ValidateCommand() with allowlist for fail2ban-client, fail2ban-regex, service, systemctl, sudo - Integrate command validation into all OSRunner methods before execution - Replace manual string parsing with ParseBracketedList() for consistency - Add bounds checking (index >= 0) to prevent negative array access - Replace nil error with descriptive error message in concurrent error channels - Update banFunc in benchmark to return success instead of permanent errors Test Coverage: - Add comprehensive security validation tests with injection attempt patterns - Add parallel operations safety tests with index validation - Add parsing consistency tests between context/non-context functions - Add error handling demonstration tests for concurrent operations - Add gzip function security requirement documentation tests * perf: implement ultra-optimized log and ban record parsing with significant performance gains Major performance improvements to core fail2ban processing with comprehensive benchmarking: Performance Achievements: • Ban record parsing: 15% faster, 39% less memory, 45% fewer allocations • Log processing: 27% faster, 64% less memory, 32% fewer allocations • Cache performance: 624x faster cache hits with zero allocations • String pooling: 4.7x improvement with zero memory allocations Core Optimizations: • Object pooling (sync.Pool) for string slices, scanner buffers, and line buffers • Comprehensive caching (sync.Map) for gzip detection, file info, and path patterns • Fast path optimizations with extension-based gzip detection • Byte-level operations to reduce string allocations in filtering • Ultra-optimized parsers with smart field parsing and efficient time handling New Files: • fail2ban/ban_record_parser_optimized.go - High-performance ban record parser • fail2ban/log_performance_optimized.go - Ultra-optimized log processor with caching • fail2ban/ban_record_parser_benchmark_test.go - Ban record parsing benchmarks • fail2ban/log_performance_benchmark_test.go - Log performance benchmarks • fail2ban/ban_record_parser_compatibility_test.go - Compatibility verification tests Updated: • fail2ban/fail2ban.go - Integration with ultra-optimized parsers • TODO.md - Marked performance optimization tasks as completed * fix(ci): install dev dependencies for pre-commit * refactor: streamline pre-commit config and extract test helpers - Replace local hooks with upstream pre-commit repositories for better maintainability - Add new hooks: shellcheck, shfmt, checkov for enhanced code quality - Extract common test helpers into dedicated test_helpers.go to reduce duplication - Add warning logs for unreadable log files in fail2ban and logs packages - Remove hard-coded GID checks in sudo.go for better cross-platform portability - Update golangci-lint installation method in Makefile * fix(security): path traversal, log file validation * feat: complete pre-release modernization with comprehensive testing - Remove all deprecated legacy functions and dead code paths - Add security hardening with sanitized error messages - Implement comprehensive performance benchmarks and security audit tests - Mark all pre-release modernization tasks as completed (10/10) - Update project documentation to reflect full completion status * fix(ci): linting, and update gosec install source * feat: implement comprehensive test framework with 60-70% code reduction Major test infrastructure modernization: - Create fluent CommandTestBuilder framework for streamlined test creation - Add MockClientBuilder pattern for advanced mock configuration - Standardize table test field naming (expectedOut→wantOutput, expectError→wantError) - Consolidate test code: 3,796 insertions, 3,104 deletions (net +692 lines with enhanced functionality) Framework achievements: - 168+ tests passing with zero regressions - 5 cmd test files fully migrated to new framework - 63 field name standardizations applied - Advanced mock patterns with fluent interface File organization improvements: - Rename all test files with consistent prefixes (cmd_*, fail2ban_*, main_*) - Split monolithic test files into focused, maintainable modules - Eliminate cmd_test.go (622 lines) and main_test.go (825 lines) - Create specialized test files for better organization Documentation enhancements: - Update docs/testing.md with complete framework documentation - Optimize TODO.md from 231→72 lines (69% token reduction) - Add comprehensive migration guides and best practices Test framework components: - command_test_framework.go: Core fluent interface implementation - MockClientBuilder: Advanced mock configuration with builder pattern - table_test_standards.go: Standardized field naming conventions - Enhanced test helpers with error checking consolidation * chore: fixes, .go-version, linting * fix(ci) editorconfig in .pre-commit-config.yaml * fix: too broad gitignore * chore: update fail2ban/fail2ban_path_security_test.go Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Signed-off-by: Ismo Vuorinen <ismo@ivuorinen.net> * chore: code review fixes * chore: code review fixes * fix: more code review fixes * fix: more code review fixes * feat: cleanup, fixes, testing * chore: minor config file updates - Add quotes to F2B_TIMEOUT value in .env.example for clarity - Remove testdata log exception from .gitignore (simplified) * feat: implement comprehensive monitoring with structured logging and metrics - Add structured logging with context propagation throughout codebase - Implement ContextualLogger with request tracking and operation timing - Add context values for operation, IP, jail, command, and request ID - Integrate with existing logrus logging infrastructure - Add request/response timing metrics collection - Create comprehensive Metrics system with atomic counters - Track command executions, ban/unban operations, and client operations - Implement latency distribution buckets for performance analysis - Add validation cache hit/miss tracking - Enhance ban/unban commands with structured logging - Add LogOperation wrapper for automatic timing and context - Log individual jail operations with success/failure status - Integrate metrics recording with ban/unban operations - Add new 'metrics' command to expose collected metrics - Support both plain text and JSON output formats - Display system metrics (uptime, memory, goroutines) - Show operation counts, failures, and average latencies - Include latency distribution histograms - Update test infrastructure - Add tests for metrics command - Fix test helper to support persistent flags - Ensure all tests pass with new logging This completes the high-priority performance monitoring and structured logging requirements from TODO.md, providing comprehensive operational visibility into the f2b application. * docs: update TODO.md to reflect completed monitoring work - Mark structured logging and timing metrics as completed - Update test coverage stats (cmd/ improved from 66.4% to 76.8%) - Add completed infrastructure section for today's work - Update current status date and add monitoring to health indicators * feat: complete TODO.md technical debt cleanup Complete all remaining TODO.md tasks with comprehensive implementation: ## 🎯 Validation Caching Implementation - Thread-safe validation cache with sync.RWMutex protection - MetricsRecorder interface to avoid circular dependencies - Cached validation for IP, jail, filter, and command validation - Integration with existing metrics system for cache hit/miss tracking - 100% test coverage for caching functionality ## 🔧 Constants Extraction - Fail2Ban status codes: Fail2BanStatusSuccess, Fail2BanStatusAlreadyProcessed - Command constants: Fail2BanClientCommand, Fail2BanRegexCommand, Fail2BanServerCommand - File permissions: DefaultFilePermissions (0600), DefaultDirectoryPermissions (0750) - Timeout limits: MaxCommandTimeout, MaxFileTimeout, MaxParallelTimeout - Updated all references throughout codebase to use named constants ## 📊 Test Coverage Improvement - Increased fail2ban package coverage from 62.0% to 70.3% (target: 70%+) - Added 6 new comprehensive test files with 200+ additional test cases - Coverage improvements across all major components: - Context helpers, validation cache, mock clients, OS runner methods - Error constructors, timing operations, cache statistics - Thread safety and concurrency testing ## 🛠️ Code Quality & Fixes - Fixed all linting issues (golangci-lint, revive, errcheck) - Resolved unused parameter warnings and error handling - Fixed timing-dependent test failures in worker pool cancellation - Enhanced thread safety in validation caching ## 📈 Final Metrics - Overall test coverage: 72.4% (up from ~65%) - fail2ban package: 70.3% (exceeds 70% target) - cmd package: 76.9% - Zero TODO/FIXME/HACK comments in production code - 100% linting compliance * fix: resolve test framework issues and update documentation - Remove unnecessary defer/recover block in comprehensive_framework_test.go - Fix compilation error in command_test_framework.go variable redeclaration - Update TODO.md to reflect all 12 completed code quality fixes - Clean up dead code and improve test maintainability - Fix linting issues: error handling, code complexity, security warnings - Break down complex test function to reduce cyclomatic complexity * fix: replace dangerous test commands with safe placeholders Replaces actual dangerous commands in test cases with safe placeholder patterns to prevent accidental execution while maintaining comprehensive security testing. - Replace 'rm -rf /', 'cat /etc/passwd' with 'DANGEROUS_RM_COMMAND', 'DANGEROUS_SYSTEM_CALL' - Update GetDangerousCommandPatterns() to recognize both old and new patterns - Enhance filter validation with command injection protection (semicolons, pipes, backticks, dollar signs) - Add package documentation comments for all packages (main, cmd, fail2ban) - Fix GoReleaser static linking configuration for cross-platform builds - Remove Docker platform restriction to enable multi-arch support - Apply code formatting and linting fixes All security validation tests continue to pass with the safe placeholders. * fix: resolve TestMixedConcurrentOperations race condition and command key mismatches The concurrency test was failing due to several issues: 1. **Command Key Mismatch**: Test setup used "sudo test arg" key but MockRunner looked for "test arg" because "test" command doesn't require sudo 2. **Invalid Commands**: Using "test" and "echo" commands that aren't in the fail2ban command allowlist, causing validation failures 3. **Race Conditions**: Multiple goroutines setting different MockRunners simultaneously, overwriting responses **Solution:** - Replace invalid test commands ("test", "echo") with valid fail2ban commands ("fail2ban-client status", "fail2ban-client -V") - Pre-configure shared MockRunner with all required response keys for both sudo and non-sudo execution paths - Improve test structure to reduce race conditions between setup and execution All tests now pass reliably, resolving the CI failure. * fix: address code quality issues and improve test coverage - Replace unsafe type assertion with comma-ok idiom in logging - Fix TestTestFilter to use created filter instead of nonexistent - Add warning logs for invalid log level configurations - Update TestVersionCommand to use consistent test framework pattern - Remove unused LoggerContextKey constant - Add version command support to test framework - Fix trailing whitespace in test files * feat: add timeout handling and multi-architecture Docker support * test: enhance path traversal security test coverage * chore: comprehensive documentation update and linting fixes Updated all documentation to reflect current capabilities including context-aware operations, multi-architecture Docker support, advanced security features, and performance monitoring. Removed unused functions and fixed all linting issues. * fix(lint): .goreleaser.yaml * feat: add markdown link checker and fix all linting issues - Add markdown-link-check to pre-commit hooks with comprehensive configuration - Fix GitHub workflow structure (sync-labels.yml) with proper job setup - Add JSON schemas to all configuration files for better IDE support - Update tool installation in Makefile for markdown-link-check dependency - Fix all revive linting issues (Boolean literals, defer in loop, if-else simplification, method naming) - Resolve broken relative link in CONTRIBUTING.md - Configure rate limiting and ignore patterns for GitHub URLs - Enhance CLAUDE.md with link checking documentation * fix(ci): sync-labels permissions * docs: comprehensive documentation update reflecting current project status - Updated TODO.md to show production-ready status with 21 commands - Enhanced README.md with enterprise-grade features and capabilities - Added performance monitoring and timeout configuration to FAQ - Updated CLAUDE.md with accurate project architecture overview - Fixed all line length issues to meet EditorConfig requirements - Added .mega-linter.yml configuration for enhanced linting * fix: address CodeRabbitAI review feedback - Split .goreleaser.yaml builds for static/dynamic linking by architecture - Update docs to accurately reflect 7 path traversal patterns (not 17) - Fix containsPathTraversal to allow valid absolute paths - Replace runnerCombinedRunWithSudoContext with RunnerCombinedOutputWithSudoContext - Fix ldflags to use uppercase Version variable name - Remove duplicate test coverage metrics in TODO.md - Fix .markdown-link-check.json schema violations - Add v8r JSON validator to pre-commit hooks * chore(ci): update workflows, switch v8r to check-jsonschema * fix: restrict static linking to amd64 only in .goreleaser.yaml - Move arm64 from static to dynamic build configuration - Static linking now only applies to linux/amd64 - Prevents build failures due to missing static libc on ARM64 - All architectures remain supported with appropriate linking * fix(ci): caching * fix(ci): python caching with pip, node with npm * fix(ci): no caching for node then * fix(ci): no requirements.txt, no cache * refactor: address code review feedback - Pin Alpine base image to v3.20 for reproducible builds - Remove redundant --platform flags in GoReleaser Docker configs - Fix unused parameters in concurrency test goroutines - Simplify string search helper using strings.Contains() - Remove redundant error checking logic in security tests --------- Signed-off-by: Ismo Vuorinen <ismo@ivuorinen.net> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
485 lines
16 KiB
Markdown
485 lines
16 KiB
Markdown
# Security Guide
|
|
|
|
## Security Model
|
|
|
|
f2b is designed with security as a fundamental principle. The tool handles privileged operations safely while
|
|
maintaining usability and providing clear security boundaries. Enhanced with context-aware timeout handling,
|
|
comprehensive path traversal protection, and advanced security testing with 17 sophisticated attack vectors.
|
|
|
|
### Threat Model
|
|
|
|
**Assumptions:**
|
|
|
|
- Users may have varying privilege levels (root, sudo, regular user)
|
|
- Input may be malicious or crafted to exploit vulnerabilities
|
|
- The system may be under attack when f2b is used for incident response
|
|
- Tests should never compromise the host system
|
|
- Operations may timeout or hang, requiring graceful handling
|
|
- Advanced path traversal attacks using Unicode normalization and mixed cases may be attempted
|
|
|
|
**Protected Assets:**
|
|
|
|
- System integrity through safe privilege escalation with timeout protection
|
|
- Fail2Ban configuration and state
|
|
- User data and system logs
|
|
- Test environment isolation with comprehensive mock setup
|
|
- Path traversal protection against sophisticated attack vectors
|
|
- Context-aware operations preventing resource exhaustion
|
|
|
|
## Privilege Management
|
|
|
|
### Automatic Privilege Detection
|
|
|
|
f2b intelligently manages sudo requirements through a comprehensive privilege checking system:
|
|
|
|
#### User Categories
|
|
|
|
- **Root users (UID 0)**: Commands run directly without sudo
|
|
- **Sudo group members**: Automatic escalation for privileged operations
|
|
- **Users with sudo access**: Detected via `sudo -n true` test
|
|
- **Regular users**: Clear error messages with guidance
|
|
|
|
#### Command Classification
|
|
|
|
**Require sudo:**
|
|
|
|
- `ban`, `unban` operations
|
|
- `service` control commands
|
|
- Configuration modifications
|
|
|
|
**No sudo needed:**
|
|
|
|
- `status`, `list-jails`, `test`
|
|
- `logs`, `version`, `completion`
|
|
- Read-only operations
|
|
|
|
### Privilege Escalation Process
|
|
|
|
1. **Pre-flight Check**: Determine user capabilities before command execution
|
|
2. **Context Creation**: Create context with timeout for the operation
|
|
3. **Command Classification**: Identify if the operation requires privileges
|
|
4. **Smart Escalation**: Only add sudo when necessary for specific commands
|
|
5. **Validation**: Ensure privilege escalation succeeded with timeout protection
|
|
6. **Execution**: Run command with appropriate privileges and context
|
|
7. **Timeout Handling**: Gracefully handle hanging operations with cancellation
|
|
8. **Audit**: Log privileged operations with context information
|
|
|
|
### Error Handling
|
|
|
|
When privileges are insufficient:
|
|
|
|
```text
|
|
Error: fail2ban operations require sudo privileges. Current user: username (UID: 1000).
|
|
Please run with sudo or ensure user is in sudo group
|
|
Hint: Try running with 'sudo' or ensure your user is in the sudo group
|
|
Example: sudo f2b ban 192.168.1.100
|
|
```
|
|
|
|
## Input Validation
|
|
|
|
### IP Address Validation
|
|
|
|
Comprehensive validation with caching prevents injection attacks:
|
|
|
|
```go
|
|
func ValidateIP(ip string) error {
|
|
if ip == "" {
|
|
return fmt.Errorf("IP address cannot be empty")
|
|
}
|
|
|
|
// Check validation cache first for performance
|
|
if IsIPValidCached(ip) {
|
|
return nil
|
|
}
|
|
|
|
// Check for valid IPv4 or IPv6 address
|
|
parsed := net.ParseIP(ip)
|
|
if parsed == nil {
|
|
return fmt.Errorf("invalid IP address: %s", ip)
|
|
}
|
|
|
|
// Cache successful validation
|
|
CacheIPValidation(ip, true)
|
|
return nil
|
|
}
|
|
```
|
|
|
|
**Protected against:**
|
|
|
|
- Command injection via IP parameters
|
|
- Path traversal attempts
|
|
- Buffer overflow attacks
|
|
- Format string vulnerabilities
|
|
- Performance degradation through validation caching
|
|
|
|
### Jail Name Validation
|
|
|
|
Prevents directory traversal and command injection:
|
|
|
|
```go
|
|
func ValidateJail(jail string) error {
|
|
if jail == "" {
|
|
return fmt.Errorf("jail name cannot be empty")
|
|
}
|
|
|
|
// Allow only alphanumeric, dash, underscore, dot
|
|
validJailRegex := regexp.MustCompile(`^[a-zA-Z0-9._-]+$`)
|
|
if !validJailRegex.MatchString(jail) {
|
|
return fmt.Errorf("invalid jail name: %s", jail)
|
|
}
|
|
|
|
return nil
|
|
}
|
|
```
|
|
|
|
### Advanced Path Traversal Protection
|
|
|
|
Comprehensive protection against sophisticated path traversal attacks:
|
|
|
|
```go
|
|
func ValidateFilter(filter string) error {
|
|
if filter == "" {
|
|
return fmt.Errorf("filter name cannot be empty")
|
|
}
|
|
|
|
// Path traversal protection checking for:
|
|
// - Basic directory traversal (..)
|
|
// - URL encoding (%2e%2e, %2f, %5c)
|
|
// - Null byte injection (\x00)
|
|
// - Unicode normalization attacks (\u002e\u002e, \u002f, \u005c)
|
|
|
|
if containsPathTraversal(filter) {
|
|
return fmt.Errorf("invalid filter name contains path traversal: %s", filter)
|
|
}
|
|
|
|
return nil
|
|
}
|
|
|
|
func containsPathTraversal(path string) bool {
|
|
// Comprehensive path traversal detection
|
|
dangerous := []string{
|
|
"..", "\x00",
|
|
"%2e%2e", "%2f", "%5c",
|
|
"\u002e\u002e", "\u002f", "\u005c",
|
|
}
|
|
|
|
normalized := strings.ToLower(path)
|
|
for _, pattern := range dangerous {
|
|
if strings.Contains(normalized, pattern) {
|
|
return true
|
|
}
|
|
}
|
|
|
|
return false
|
|
}
|
|
```
|
|
|
|
## Safe Command Execution
|
|
|
|
### Argument Array Pattern
|
|
|
|
**Never use shell string concatenation:**
|
|
|
|
```go
|
|
// DANGEROUS - DON'T DO THIS
|
|
cmd := exec.Command("sh", "-c", fmt.Sprintf("fail2ban-client ban %s %s", ip, jail))
|
|
|
|
// SAFE - Use argument arrays
|
|
cmd := exec.Command("fail2ban-client", "ban", ip, jail)
|
|
```
|
|
|
|
### Context-Aware Secure Runner Interface
|
|
|
|
The `Runner` interface provides safe command execution with timeout handling:
|
|
|
|
```go
|
|
type Runner interface {
|
|
CombinedOutput(name string, args ...string) ([]byte, error)
|
|
CombinedOutputWithSudo(name string, args ...string) ([]byte, error)
|
|
CombinedOutputWithContext(ctx context.Context, name string, args ...string) ([]byte, error)
|
|
CombinedOutputWithSudoContext(ctx context.Context, name string, args ...string) ([]byte, error)
|
|
}
|
|
```
|
|
|
|
### Context-Aware Implementation
|
|
|
|
```go
|
|
func (r *RealRunner) CombinedOutputWithSudoContext(ctx context.Context, name string, args ...string) ([]byte, error) {
|
|
// Validate inputs
|
|
if name == "" {
|
|
return nil, fmt.Errorf("command name cannot be empty")
|
|
}
|
|
|
|
// Build command with argument array
|
|
cmdArgs := append([]string{name}, args...)
|
|
cmd := exec.CommandContext(ctx, "sudo", cmdArgs...)
|
|
|
|
// Execute safely with timeout protection
|
|
output, err := cmd.CombinedOutput()
|
|
if ctx.Err() != nil {
|
|
return nil, fmt.Errorf("command timeout: %w", ctx.Err())
|
|
}
|
|
|
|
return output, err
|
|
}
|
|
```
|
|
|
|
**Security enhancements:**
|
|
|
|
- Context-based timeout prevention
|
|
- Graceful cancellation of hanging operations
|
|
- Resource cleanup on timeout
|
|
- Enhanced error reporting with context information
|
|
|
|
## Testing Security
|
|
|
|
### Mock-Only Testing
|
|
|
|
**Critical Rule**: Never execute real sudo commands in tests
|
|
|
|
```go
|
|
// CORRECT - Use modern standardized helpers with context support
|
|
func TestBanCommand_WithPrivileges(t *testing.T) {
|
|
// Modern standardized setup with automatic cleanup and context support
|
|
_, cleanup := fail2ban.SetupMockEnvironmentWithSudo(t, true)
|
|
defer cleanup()
|
|
|
|
// Create context with timeout for the test
|
|
ctx, cancel := context.WithTimeout(context.Background(), time.Second*5)
|
|
defer cancel()
|
|
|
|
// Test implementation with context-aware operations
|
|
err := client.BanIPWithContext(ctx, "192.168.1.100", "sshd")
|
|
// Test assertions...
|
|
}
|
|
```
|
|
|
|
### Advanced Security Test Coverage
|
|
|
|
The system includes comprehensive security testing with 17 sophisticated attack vectors:
|
|
|
|
```go
|
|
func TestPathTraversalProtection(t *testing.T) {
|
|
testCases := []struct {
|
|
name string
|
|
input string
|
|
expect bool // true if should be blocked
|
|
}{
|
|
{"Basic traversal", "../../../etc/passwd", true},
|
|
{"URL encoded", "%2e%2e%2f%2e%2e%2f%2e%2e%2fetc%2fpasswd", true},
|
|
{"Null byte injection", "valid\x00/../../../etc/passwd", true},
|
|
{"Unicode normalization", "/var/log/\u002e\u002e/\u002e\u002e/etc/passwd", true},
|
|
{"Mixed case", "/var/LOG/../../../etc/passwd", true},
|
|
{"Multiple slashes", "/var/log////../../etc/passwd", true},
|
|
{"Windows style", "/var/log\\..\\..\\..\etc\passwd", true},
|
|
{"Valid path", "/var/log/fail2ban.log", false},
|
|
}
|
|
|
|
for _, tc := range testCases {
|
|
t.Run(tc.name, func(t *testing.T) {
|
|
blocked := containsPathTraversal(tc.input)
|
|
assert.Equal(t, tc.expect, blocked)
|
|
})
|
|
}
|
|
}
|
|
```
|
|
|
|
### Test Environment Isolation
|
|
|
|
```go
|
|
func setupSecureTestEnvironment(t *testing.T) {
|
|
// Modern standardized setup with complete isolation and context support
|
|
_, cleanup := fail2ban.SetupMockEnvironmentWithSudo(t, true)
|
|
defer cleanup()
|
|
|
|
// All mock environment is configured with:
|
|
// - Proper isolation and privilege handling
|
|
// - Context-aware timeout operations
|
|
// - Thread-safe mock operations
|
|
// - Comprehensive path traversal protection testing
|
|
}
|
|
```
|
|
|
|
## Security Checklist
|
|
|
|
### For Contributors
|
|
|
|
**Before submitting code:**
|
|
|
|
- [ ] All user input is validated before use with caching where appropriate
|
|
- [ ] No shell string concatenation used
|
|
- [ ] Privilege escalation only when necessary with timeout protection
|
|
- [ ] Tests use mocks exclusively with context support
|
|
- [ ] No hardcoded credentials or paths
|
|
- [ ] Error messages don't leak sensitive information
|
|
- [ ] Input sanitization prevents injection attacks including advanced path traversal
|
|
- [ ] Context-aware operations implemented with proper timeout handling
|
|
- [ ] Path traversal protection covers all 17 sophisticated attack vectors
|
|
- [ ] Thread-safe operations for concurrent access
|
|
|
|
### For Security-Critical Changes
|
|
|
|
**Additional requirements:**
|
|
|
|
- [ ] Threat model updated if attack surface changes
|
|
- [ ] Security tests added for new attack vectors with context support
|
|
- [ ] Privilege boundaries clearly documented with timeout behavior
|
|
- [ ] Code review by maintainer required
|
|
- [ ] Integration tests verify security behavior including timeout scenarios
|
|
- [ ] Path traversal protection tested against sophisticated attack vectors
|
|
- [ ] Context-aware timeout handling properly implemented
|
|
- [ ] Thread safety verified for concurrent operations
|
|
|
|
## Known Security Issues (Fixed)
|
|
|
|
### Historical Vulnerabilities
|
|
|
|
#### 1. Sudo Timeout (Fixed)
|
|
|
|
- **Issue**: Infinite wait on sudo prompt
|
|
- **Impact**: Denial of service via hanging processes
|
|
- **Fix**: 5-second timeout added to `CanUseSudo()`
|
|
|
|
#### 2. Service Command Injection (Fixed)
|
|
|
|
- **Issue**: Insufficient validation of service actions
|
|
- **Impact**: Command injection via service parameters
|
|
- **Fix**: Strict action validation implemented
|
|
|
|
#### 3. Memory Exhaustion (Fixed)
|
|
|
|
- **Issue**: Unbounded log reading
|
|
- **Impact**: Memory exhaustion via large log files
|
|
- **Fix**: Incremental reading with 1000 lines/100MB limits
|
|
|
|
#### 4. Path Traversal (Enhanced Protection)
|
|
|
|
- **Issue**: Insufficient path validation against sophisticated attacks
|
|
- **Impact**: Access to files outside intended directories
|
|
- **Fix**: Comprehensive path traversal protection with 17 test cases covering:
|
|
- Unicode normalization attacks (\u002e\u002e)
|
|
- Mixed case traversal (/var/LOG/../../../etc/passwd)
|
|
- Multiple slashes (/var/log////../../etc/passwd)
|
|
- Windows-style paths on Unix (/var/log\..\..\..\etc\passwd)
|
|
- URL encoding variants (%2e%2e%2f)
|
|
- Null byte injection attacks
|
|
|
|
#### 5. Race Conditions (Fixed)
|
|
|
|
- **Issue**: Concurrent access to shared state
|
|
- **Impact**: Data corruption in multi-threaded scenarios
|
|
- **Fix**: Thread-safe runner management with RWMutex and atomic operations
|
|
|
|
#### 6. Hanging Operations (Fixed)
|
|
|
|
- **Issue**: Operations could hang indefinitely without timeout protection
|
|
- **Impact**: Resource exhaustion and denial of service
|
|
- **Fix**: Context-aware operations with configurable timeouts and graceful cancellation
|
|
|
|
## Security Architecture
|
|
|
|
### Defense in Depth
|
|
|
|
1. **Input Validation**: First line of defense against malicious input with caching
|
|
2. **Advanced Path Traversal Protection**: 17 sophisticated attack vector protection
|
|
3. **Privilege Validation**: Ensure user has necessary permissions with timeout protection
|
|
4. **Context-Aware Execution**: Use argument arrays with timeout and cancellation support
|
|
5. **Safe Execution**: Never use shell strings, always use context-aware operations
|
|
6. **Error Handling**: Fail safely without information leakage, include context information
|
|
7. **Audit Logging**: Track privileged operations with contextual information
|
|
8. **Test Isolation**: Prevent test-time security compromises with comprehensive mocks
|
|
9. **Performance Security**: Validation caching prevents DoS through repeated validation
|
|
10. **Timeout Protection**: Prevent resource exhaustion through hanging operations
|
|
|
|
### Security Boundaries
|
|
|
|
```text
|
|
User Input → Context → Validation → Path Traversal → Privilege Check → Safe Execution → Timeout → Audit
|
|
↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓
|
|
Sanitize → Create → Cache Check → Block Attack → Verify Perms → Exec w/Context → Cancel → Log
|
|
```
|
|
|
|
**Enhanced Security Flow:**
|
|
|
|
1. **Context Creation**: Establish timeout and cancellation context
|
|
2. **Input Sanitization**: Clean and validate all user input
|
|
3. **Cache Validation**: Check validation cache for performance and DoS protection
|
|
4. **Path Traversal Protection**: Block 17 sophisticated attack vectors
|
|
5. **Privilege Verification**: Confirm user permissions with timeout protection
|
|
6. **Context-Aware Execution**: Execute with timeout and cancellation support
|
|
7. **Timeout Handling**: Gracefully handle hanging operations
|
|
8. **Comprehensive Auditing**: Log all operations with context information
|
|
|
|
## Incident Response
|
|
|
|
### Security Issue Reporting
|
|
|
|
**For security vulnerabilities:**
|
|
|
|
1. **Do not** open public GitHub issues
|
|
2. Email: `ismo@ivuorinen.net` with subject "SECURITY: f2b vulnerability"
|
|
3. Include: Description, impact assessment, reproduction steps
|
|
4. Expect: Acknowledgment within 48 hours
|
|
|
|
### Security Update Process
|
|
|
|
1. **Assessment**: Evaluate impact and affected versions
|
|
2. **Development**: Create fix with security tests
|
|
3. **Testing**: Comprehensive security testing
|
|
4. **Release**: Coordinated disclosure with security advisory
|
|
5. **Communication**: Notify users via GitHub security advisories
|
|
|
|
## Security Best Practices
|
|
|
|
### For Users
|
|
|
|
- Run with minimal privileges necessary
|
|
- Regularly update to latest version
|
|
- Monitor logs for unexpected privilege escalations
|
|
- Use structured logging for audit trails
|
|
- Validate f2b binary checksums after download
|
|
|
|
### For Developers
|
|
|
|
- Follow secure coding guidelines
|
|
- Use static analysis tools (gosec, golangci-lint)
|
|
- Implement comprehensive security tests
|
|
- Document security assumptions
|
|
- Regular security code reviews
|
|
|
|
### For Deployment
|
|
|
|
- Use principle of least privilege
|
|
- Monitor privileged command execution
|
|
- Implement log aggregation and monitoring
|
|
- Regular security updates
|
|
- Network segmentation where applicable
|
|
|
|
## Security Monitoring
|
|
|
|
### Audit Points
|
|
|
|
- Privilege escalation attempts
|
|
- Failed authentication events
|
|
- Malformed input attempts
|
|
- Unusual command patterns
|
|
- File access outside expected directories
|
|
|
|
### Logging Security Events
|
|
|
|
```go
|
|
logger.WithFields(logrus.Fields{
|
|
"user": os.Getenv("USER"),
|
|
"uid": os.Getuid(),
|
|
"command": "ban",
|
|
"target_ip": ip,
|
|
"jail": jail,
|
|
"sudo_used": true,
|
|
}).Info("Privileged operation executed")
|
|
```
|
|
|
|
This comprehensive security model ensures f2b can be used safely in production environments while maintaining the
|
|
flexibility needed for effective Fail2Ban management. The enhanced security features include context-aware timeout
|
|
handling, sophisticated path traversal protection with 17 attack vector coverage, performance-optimized validation
|
|
caching, and comprehensive audit logging for enterprise-grade security monitoring.
|