mirror of
https://github.com/ivuorinen/actions.git
synced 2026-01-26 11:34:00 +00:00
* feat: fixes, tweaks, new actions, linting * fix: improve docker publish loops and dotnet parsing (#193) * fix: harden action scripts and version checks (#191) * refactor: major repository restructuring and security enhancements Add comprehensive development infrastructure: - Add Makefile with automated documentation generation, formatting, and linting tasks - Add TODO.md tracking self-containment progress and repository improvements - Add .nvmrc for consistent Node.js version management - Create python-version-detect-v2 action for enhanced Python detection Enhance all GitHub Actions with standardized patterns: - Add consistent token handling across 27 actions using standardized input patterns - Implement bash error handling (set -euo pipefail) in all shell steps - Add comprehensive input validation for path traversal and command injection protection - Standardize checkout token authentication to prevent rate limiting - Remove relative action dependencies to ensure external usability Rewrite security workflow for PR-focused analysis: - Transform security-suite.yml to PR-only security analysis workflow - Remove scheduled runs, repository issue management, and Slack notifications - Implement smart comment generation showing only sections with content - Add GitHub Actions permission diff analysis and new action detection - Integrate OWASP, Semgrep, and TruffleHog for comprehensive PR security scanning Improve version detection and dependency management: - Simplify version detection actions to use inline logic instead of shared utilities - Fix Makefile version detection fallback to properly return 'main' when version not found - Update all external action references to use SHA-pinned versions - Remove deprecated run.sh in favor of Makefile automation Update documentation and project standards: - Enhance CLAUDE.md with self-containment requirements and linting standards - Update README.md with improved action descriptions and usage examples - Standardize code formatting with updated .editorconfig and .prettierrc.yml - Improve GitHub templates for issues and security reporting This refactoring ensures all 40 actions are fully self-contained and can be used independently when referenced as ivuorinen/actions/action-name@main, addressing the critical requirement for external usability while maintaining comprehensive security analysis and development automation. * feat: add automated action catalog generation system - Create generate_listing.cjs script for comprehensive action catalog - Add package.json with development tooling and npm scripts - Implement automated README.md catalog section with --update flag - Generate markdown reference-style links for all 40 actions - Add categorized tables with features, language support matrices - Replace static reference links with auto-generated dynamic links - Enable complete automation of action documentation maintenance * feat: enhance actions with improved documentation and functionality - Add comprehensive README files for 12 actions with usage examples - Implement new utility actions (go-version-detect, dotnet-version-detect) - Enhance node-setup with extensive configuration options - Improve error handling and validation across all actions - Update package.json scripts for better development workflow - Expand TODO.md with detailed roadmap and improvement plans - Standardize action structure with consistent inputs/outputs * feat: add comprehensive output handling across all actions - Add standardized outputs to 15 actions that previously had none - Implement consistent snake_case naming convention for all outputs - Add build status and test results outputs to build actions - Add files changed and status outputs to lint/fix actions - Add test execution metrics to php-tests action - Add stale/closed counts to stale action - Add release URLs and IDs to github-release action - Update documentation with output specifications - Mark comprehensive output handling task as complete in TODO.md * feat: implement shared cache strategy across all actions - Add caching to 10 actions that previously had none (Node.js, .NET, Python, Go) - Standardize 4 existing actions to use common-cache instead of direct actions/cache - Implement consistent cache-hit optimization to skip installations when cache available - Add language-specific cache configurations with appropriate key files - Create unified caching approach using ivuorinen/actions/common-cache@main - Fix YAML syntax error in php-composer action paths parameter - Update TODO.md to mark shared cache strategy as complete * feat: implement comprehensive retry logic for network operations - Create new common-retry action for standardized retry patterns with configurable strategies - Add retry logic to 9 actions missing network retry capabilities - Implement exponential backoff, custom timeouts, and flexible error handling - Add max-retries input parameter to all network-dependent actions (Node.js, .NET, Python, Go) - Standardize existing retry implementations to use common-retry utility - Update action catalog to include new common-retry action (41 total actions) - Update documentation with retry configuration examples and parameters - Mark retry logic implementation as complete in TODO.md roadmap * feat: enhance Node.js support with Corepack and Bun - Add Corepack support for automatic package manager version management - Add Bun package manager support across all Node.js actions - Improve Yarn Berry/PnP support with .yarnrc.yml detection - Add Node.js feature detection (ESM, TypeScript, frameworks) - Update package manager detection priority and lockfile support - Enhance caching with package-manager-specific keys - Update eslint, prettier, and biome actions for multi-package-manager support * fix: resolve critical runtime issues across multiple actions - Fix token validation by removing ineffective literal string comparisons - Add missing @microsoft/eslint-formatter-sarif dependency for SARIF output - Fix Bash variable syntax errors in username and changelog length checks - Update Dockerfile version regex to handle tags with suffixes (e.g., -alpine) - Simplify version selection logic with single grep command - Fix command execution in retry action with proper bash -c wrapper - Correct step output references using .outcome instead of .outputs.outcome - Add missing step IDs for version detection actions - Include go.mod in cache key files for accurate invalidation - Require minor version in all version regex patterns - Improve Bun installation security by verifying script before execution - Replace bc with sort -V for portable PHP version comparison - Remove non-existent pre-commit output references These fixes ensure proper runtime behavior, improved security, and better cross-platform compatibility across all affected actions. * fix: resolve critical runtime and security issues across actions - Fix biome-fix files_changed calculation using git diff instead of git status delta - Fix compress-images output description and add absolute path validation - Remove csharp-publish token default and fix token fallback in push commands - Add @microsoft/eslint-formatter-sarif to all package managers in eslint-check - Fix eslint-check command syntax by using variable assignment - Improve node-setup Bun installation security and remove invalid frozen-lockfile flag - Fix pre-commit token validation by removing ineffective literal comparison - Fix prettier-fix token comparison and expand regex for all GitHub token types - Add version-file-parser regex validation safety and fix csproj wildcard handling These fixes address security vulnerabilities, runtime errors, and functional issues to ensure reliable operation across all affected GitHub Actions. * feat: enhance Docker actions with advanced multi-architecture support Major enhancement to Docker build and publish actions with comprehensive multi-architecture capabilities and enterprise-grade features. Added features: - Advanced buildx configuration (version control, cache modes, build contexts) - Auto-detect platforms for dynamic architecture discovery - Performance optimizations with enhanced caching strategies - Security scanning with Trivy and image signing with Cosign - SBOM generation in multiple formats with validation - Verbose logging and dry-run modes for debugging - Platform-specific build args and fallback mechanisms Enhanced all Docker actions: - docker-build: Core buildx features and multi-arch support - docker-publish-gh: GitHub Packages with security features - docker-publish-hub: Docker Hub with scanning and signing - docker-publish: Orchestrator with unified configuration Updated documentation across all modified actions. * fix: resolve documentation generation placeholder issue Fixed Makefile and package.json to properly replace placeholder tokens in generated documentation, ensuring all README files show correct repository paths instead of ***PROJECT***@***VERSION***. * chore: simplify github token validation * chore(lint): optional yamlfmt, config and fixes * feat: use relative `uses` names * feat: comprehensive testing infrastructure and Python validation system - Migrate from tests/ to _tests/ directory structure with ShellSpec framework - Add comprehensive validation system with Python-based input validation - Implement dual testing approach (ShellSpec + pytest) for complete coverage - Add modern Python tooling (uv, ruff, pytest-cov) and dependencies - Create centralized validation rules with automatic generation system - Update project configuration and build system for new architecture - Enhance documentation to reflect current testing capabilities This establishes a robust foundation for action validation and testing with extensive coverage across all GitHub Actions in the repository. * chore: remove Dockerfile for now * chore: code review fixes * feat: comprehensive GitHub Actions restructuring and tooling improvements This commit represents a major restructuring of the GitHub Actions monorepo with improved tooling, testing infrastructure, and comprehensive PR #186 review implementation. ## Major Changes ### 🔧 Development Tooling & Configuration - **Shellcheck integration**: Exclude shellspec test files from linting - Updated .pre-commit-config.yaml to exclude _tests/*.sh from shellcheck/shfmt - Modified Makefile shellcheck pattern to skip shellspec files - Updated CLAUDE.md documentation with proper exclusion syntax - **Testing infrastructure**: Enhanced Python validation framework - Fixed nested if statements and boolean parameter issues in validation.py - Improved code quality with explicit keyword arguments - All pre-commit hooks now passing ### 🏗️ Project Structure & Documentation - **Added Serena AI integration** with comprehensive project memories: - Project overview, structure, and technical stack documentation - Code style conventions and completion requirements - Comprehensive PR #186 review analysis and implementation tracking - **Enhanced configuration**: Updated .gitignore, .yamlfmt.yml, pyproject.toml - **Improved testing**: Added integration workflows and enhanced test specs ### 🚀 GitHub Actions Improvements (30+ actions updated) - **Centralized validation**: Updated 41 validation rule files - **Enhanced actions**: Improvements across all action categories: - Setup actions (node-setup, version detectors) - Utility actions (version-file-parser, version-validator) - Linting actions (biome, eslint, terraform-lint-fix major refactor) - Build/publish actions (docker-build, npm-publish, csharp-*) - Repository management actions ### 📝 Documentation Updates - **README consistency**: Updated version references across action READMEs - **Enhanced documentation**: Improved action descriptions and usage examples - **CLAUDE.md**: Updated with current tooling and best practices ## Technical Improvements - **Security enhancements**: Input validation and sanitization improvements - **Performance optimizations**: Streamlined action logic and dependencies - **Cross-platform compatibility**: Better Windows/macOS/Linux support - **Error handling**: Improved error reporting and user feedback ## Files Changed - 100 files changed - 13 new Serena memory files documenting project state - 41 validation rules updated for consistency - 30+ GitHub Actions and READMEs improved - Core tooling configuration enhanced * feat: comprehensive GitHub Actions improvements and PR review fixes Major Infrastructure Improvements: - Add comprehensive testing framework with 17+ ShellSpec validation tests - Implement Docker-based testing tools with automated test runner - Add CodeRabbit configuration for automated code reviews - Restructure documentation and memory management system - Update validation rules for 25+ actions with enhanced input validation - Modernize CI/CD workflows and testing infrastructure Critical PR Review Fixes (All Issues Resolved): - Fix double caching in node-setup (eliminate redundant cache operations) - Optimize shell pipeline in version-file-parser (single awk vs complex pipeline) - Fix GitHub expression interpolation in prettier-check cache keys - Resolve terraform command order issue (validation after setup) - Add missing flake8-sarif dependency for Python SARIF output - Fix environment variable scope in pr-lint (export to GITHUB_ENV) Performance & Reliability: - Eliminate duplicate cache operations saving CI time - Improve shell script efficiency with optimized parsing - Fix command execution dependencies preventing runtime failures - Ensure proper dependency installation for all linting tools - Resolve workflow conditional logic issues Security & Quality: - All input validation rules updated with latest security patterns - Cross-platform compatibility improvements maintained - Comprehensive error handling and retry logic preserved - Modern development tooling and best practices adopted This commit addresses 100% of actionable feedback from PR review analysis, implements comprehensive testing infrastructure, and maintains high code quality standards across all 41 GitHub Actions. * feat: enhance expression handling and version parsing - Fix node-setup force-version expression logic for proper empty string handling - Improve version-file-parser with secure regex validation and enhanced Python detection - Add CodeRabbit configuration for CalVer versioning and README review guidance * feat(validate-inputs): implement modular validation system - Add modular validator architecture with specialized validators - Implement base validator classes for different input types - Add validators: boolean, docker, file, network, numeric, security, token, version - Add convention mapper for automatic input validation - Add comprehensive documentation for the validation system - Implement PCRE regex support and injection protection * feat(validate-inputs): add validation rules for all actions - Add YAML validation rules for 42 GitHub Actions - Auto-generated rules with convention mappings - Include metadata for validation coverage and quality indicators - Mark rules as auto-generated to prevent manual edits * test(validate-inputs): add comprehensive test suite for validators - Add unit tests for all validator modules - Add integration tests for the validation system - Add fixtures for version test data - Test coverage for boolean, docker, file, network, numeric, security, token, and version validators - Add tests for convention mapper and registry * feat(tools): add validation scripts and utilities - Add update-validators.py script for auto-generating rules - Add benchmark-validator.py for performance testing - Add debug-validator.py for troubleshooting - Add generate-tests.py for test generation - Add check-rules-not-manually-edited.sh for CI validation - Add fix-local-action-refs.py tool for fixing action references * feat(actions): add CustomValidator.py files for specialized validation - Add custom validators for actions requiring special validation logic - Implement validators for docker, go, node, npm, php, python, terraform actions - Add specialized validation for compress-images, common-cache, common-file-check - Implement version detection validators with language-specific logic - Add validation for build arguments, architectures, and version formats * test: update ShellSpec test framework for Python validation - Update all validation.spec.sh files to use Python validator - Add shared validation_core.py for common test utilities - Remove obsolete bash validation helpers - Update test output expectations for Python validator format - Add codeql-analysis test suite - Refactor framework utilities for Python integration - Remove deprecated test files * feat(actions): update action.yml files to use validate-inputs - Replace inline bash validation with validate-inputs action - Standardize validation across all 42 actions - Add new codeql-analysis action - Update action metadata and branding - Add validation step as first step in composite actions - Maintain backward compatibility with existing inputs/outputs * ci: update GitHub workflows for enhanced security and testing - Add new codeql-new.yml workflow - Update security scanning workflows - Enhance dependency review configuration - Update test-actions workflow for new validation system - Improve workflow permissions and security settings - Update action versions to latest SHA-pinned releases * build: update build configuration and dependencies - Update Makefile with new validation targets - Add Python dependencies in pyproject.toml - Update npm dependencies and scripts - Enhance Docker testing tools configuration - Add targets for validator updates and local ref fixes - Configure uv for Python package management * chore: update linting and documentation configuration - Update EditorConfig settings for consistent formatting - Enhance pre-commit hooks configuration - Update prettier and yamllint ignore patterns - Update gitleaks security scanning rules - Update CodeRabbit review configuration - Update CLAUDE.md with latest project standards and rules * docs: update Serena memory files and project metadata - Remove obsolete PR-186 memory files - Update project overview with current architecture - Update project structure documentation - Add quality standards and communication guidelines - Add modular validator architecture documentation - Add shellspec testing framework documentation - Update project.yml with latest configuration * feat: moved rules.yml to same folder as action, fixes * fix(validators): correct token patterns and fix validator bugs - Fix GitHub classic PAT pattern: ghp_ + 36 chars = 40 total - Fix GitHub fine-grained PAT pattern: github_pat_ + 71 chars = 82 total - Initialize result variable in convention_mapper to prevent UnboundLocalError - Fix empty URL validation in network validator to return error - Add GitHub expression check to docker architectures validator - Update docker-build CustomValidator parallel-builds max to 16 * test(validators): fix test fixtures and expectations - Fix token lengths in test data: github_pat 71 chars, ghp/gho 36 chars - Update integration tests with correct token lengths - Fix file validator test to expect absolute paths rejected for security - Rename TestGenerator import to avoid pytest collection warning - Update custom validator tests with correct input names - Change docker-build tests: platforms->architectures, tags->tag - Update docker-publish tests to match new registry enum validation * test(shellspec): fix token lengths in test helpers and specs - Fix default token lengths in spec_helper.sh to use correct 40-char format - Update csharp-publish default tokens in 4 locations - Update codeql-analysis default tokens in 2 locations - Fix codeql-analysis test tokens to correct lengths (40 and 82 chars) - Fix npm-publish fine-grained token test to use 82-char format * feat(actions): add permissions documentation and environment variable usage - Add permissions comments to all action.yml files documenting required GitHub permissions - Convert direct input usage to environment variables in shell steps for security - Add validation steps with proper error handling - Update input descriptions and add security notes where applicable - Ensure all actions follow consistent patterns for input validation * chore(workflows): update GitHub Actions workflow versions - Update workflow action versions to latest - Improve workflow consistency and maintainability * docs(security): add comprehensive security policy - Document security features and best practices - Add vulnerability reporting process - Include audit history and security testing information * docs(memory): add GitHub workflow reference documentation - Add GitHub Actions workflow commands reference - Add GitHub workflow expressions guide - Add secure workflow usage patterns and best practices * chore: token optimization, code style conventions * chore: cr fixes * fix: trivy reported Dockerfile problems * fix(security): more security fixes * chore: dockerfile and make targets for publishing * fix(ci): add creds to test-actions workflow * fix: security fix and checkout step to codeql-new * chore: test fixes * fix(security): codeql detected issues * chore: code review fixes, ReDos protection * style: apply MegaLinter fixes * fix(ci): missing packages read permission * fix(ci): add missing working directory setting * chore: linting, add validation-regex to use regex_pattern * chore: code review fixes * chore(deps): update actions * fix(security): codeql fixes * chore(cr): apply cr comments * chore: improve POSIX compatibility * chore(cr): apply cr comments * fix: codeql warning in Dockerfile, build failures * chore(cr): apply cr comments * fix: docker-testing-tools/Dockerfile * chore(cr): apply cr comments * fix(docker): update testing-tools image for GitHub Actions compatibility * chore(cr): apply cr comments * feat: add more tests, fix issues * chore: fix codeql issues, update actions * chore(cr): apply cr comments * fix: integration tests * chore: deduplication and fixes * style: apply MegaLinter fixes * chore(cr): apply cr comments * feat: dry-run mode for generate-tests * fix(ci): kcov installation * chore(cr): apply cr comments * chore(cr): apply cr comments * chore(cr): apply cr comments * chore(cr): apply cr comments, simplify action testing, use uv * fix: run-tests.sh action counting * chore(cr): apply cr comments * chore(cr): apply cr comments
587 lines
19 KiB
YAML
587 lines
19 KiB
YAML
# yaml-language-server: $schema=https://json.schemastore.org/github-action.json
|
|
# permissions:
|
|
# - (none required) # Build action, publishing handled by separate actions
|
|
---
|
|
name: Docker Build
|
|
description: 'Builds a Docker image for multiple architectures with enhanced security and reliability.'
|
|
author: 'Ismo Vuorinen'
|
|
|
|
branding:
|
|
icon: 'package'
|
|
color: 'blue'
|
|
|
|
inputs:
|
|
image-name:
|
|
description: 'The name of the Docker image to build. Defaults to the repository name.'
|
|
required: false
|
|
tag:
|
|
description: 'The tag for the Docker image. Must follow semver or valid Docker tag format.'
|
|
required: true
|
|
architectures:
|
|
description: 'Comma-separated list of architectures to build for.'
|
|
required: false
|
|
default: 'linux/amd64,linux/arm64,linux/arm/v7,linux/arm/v6'
|
|
dockerfile:
|
|
description: 'Path to the Dockerfile'
|
|
required: false
|
|
default: 'Dockerfile'
|
|
context:
|
|
description: 'Docker build context'
|
|
required: false
|
|
default: '.'
|
|
build-args:
|
|
description: 'Build arguments in format KEY=VALUE,KEY2=VALUE2'
|
|
required: false
|
|
cache-from:
|
|
description: 'External cache sources (e.g., type=registry,ref=user/app:cache)'
|
|
required: false
|
|
push:
|
|
description: 'Whether to push the image after building'
|
|
required: false
|
|
default: 'true'
|
|
max-retries:
|
|
description: 'Maximum number of retry attempts for build and push operations'
|
|
required: false
|
|
default: '3'
|
|
token:
|
|
description: 'GitHub token for authentication'
|
|
required: false
|
|
default: ''
|
|
buildx-version:
|
|
description: 'Specific Docker Buildx version to use'
|
|
required: false
|
|
default: 'latest'
|
|
buildkit-version:
|
|
description: 'Specific BuildKit version to use'
|
|
required: false
|
|
default: 'v0.11.0'
|
|
cache-mode:
|
|
description: 'Cache mode for build layers (min, max, or inline)'
|
|
required: false
|
|
default: 'max'
|
|
build-contexts:
|
|
description: 'Additional build contexts in format name=path,name2=path2'
|
|
required: false
|
|
network:
|
|
description: 'Network mode for build (host, none, or default)'
|
|
required: false
|
|
default: 'default'
|
|
secrets:
|
|
description: 'Build secrets in format id=path,id2=path2'
|
|
required: false
|
|
auto-detect-platforms:
|
|
description: 'Automatically detect and build for all available platforms'
|
|
required: false
|
|
default: 'false'
|
|
platform-build-args:
|
|
description: 'Platform-specific build args in JSON format'
|
|
required: false
|
|
parallel-builds:
|
|
description: 'Number of parallel platform builds (0 for auto)'
|
|
required: false
|
|
default: '0'
|
|
cache-export:
|
|
description: 'Export cache destination (e.g., type=local,dest=/tmp/cache)'
|
|
required: false
|
|
cache-import:
|
|
description: 'Import cache sources (e.g., type=local,src=/tmp/cache)'
|
|
required: false
|
|
dry-run:
|
|
description: 'Perform a dry run without actually building'
|
|
required: false
|
|
default: 'false'
|
|
verbose:
|
|
description: 'Enable verbose logging with platform-specific output'
|
|
required: false
|
|
default: 'false'
|
|
platform-fallback:
|
|
description: 'Continue building other platforms if one fails'
|
|
required: false
|
|
default: 'true'
|
|
scan-image:
|
|
description: 'Scan built image for vulnerabilities'
|
|
required: false
|
|
default: 'false'
|
|
sign-image:
|
|
description: 'Sign the built image with cosign'
|
|
required: false
|
|
default: 'false'
|
|
sbom-format:
|
|
description: 'SBOM format (spdx-json, cyclonedx-json, or syft-json)'
|
|
required: false
|
|
default: 'spdx-json'
|
|
|
|
outputs:
|
|
image-digest:
|
|
description: 'The digest of the built image'
|
|
value: ${{ steps.build.outputs.digest }}
|
|
metadata:
|
|
description: 'Build metadata in JSON format'
|
|
value: ${{ steps.build.outputs.metadata }}
|
|
platforms:
|
|
description: 'Successfully built platforms'
|
|
value: ${{ steps.platforms.outputs.built }}
|
|
platform-matrix:
|
|
description: 'Build status per platform in JSON format'
|
|
value: ${{ steps.build.outputs.platform-matrix }}
|
|
build-time:
|
|
description: 'Total build time in seconds'
|
|
value: ${{ steps.build.outputs.build-time }}
|
|
scan-results:
|
|
description: 'Vulnerability scan results if scanning enabled'
|
|
value: ${{ steps.scan-output.outputs.results }}
|
|
signature:
|
|
description: 'Image signature if signing enabled'
|
|
value: ${{ steps.sign.outputs.signature }}
|
|
sbom-location:
|
|
description: 'SBOM document location'
|
|
value: ${{ steps.build.outputs.sbom-location }}
|
|
|
|
runs:
|
|
using: composite
|
|
steps:
|
|
- name: Validate Inputs
|
|
id: validate
|
|
uses: ./validate-inputs
|
|
with:
|
|
action-type: 'docker-build'
|
|
image-name: ${{ inputs.image-name }}
|
|
tag: ${{ inputs.tag }}
|
|
architectures: ${{ inputs.architectures }}
|
|
dockerfile: ${{ inputs.dockerfile }}
|
|
build-args: ${{ inputs.build-args }}
|
|
buildx-version: ${{ inputs.buildx-version }}
|
|
parallel-builds: ${{ inputs.parallel-builds }}
|
|
|
|
- name: Check Dockerfile Exists
|
|
shell: bash
|
|
env:
|
|
DOCKERFILE: ${{ inputs.dockerfile }}
|
|
run: |
|
|
if [ ! -f "$DOCKERFILE" ]; then
|
|
echo "::error::Dockerfile not found at $DOCKERFILE"
|
|
exit 1
|
|
fi
|
|
|
|
- name: Set up QEMU
|
|
uses: docker/setup-qemu-action@29109295f81e9208d7d86ff1c6c12d2833863392 # v3.6.0
|
|
with:
|
|
platforms: ${{ inputs.architectures }}
|
|
|
|
- name: Set up Docker Buildx
|
|
id: buildx
|
|
uses: docker/setup-buildx-action@e468171a9de216ec08956ac3ada2f0791b6bd435 # v3.11.1
|
|
with:
|
|
version: ${{ inputs.buildx-version }}
|
|
platforms: ${{ inputs.architectures }}
|
|
buildkitd-flags: --debug
|
|
driver-opts: |
|
|
network=${{ inputs.network }}
|
|
image=moby/buildkit:${{ inputs.buildkit-version }}
|
|
|
|
- name: Detect Available Platforms
|
|
id: detect-platforms
|
|
if: inputs.auto-detect-platforms == 'true'
|
|
shell: bash
|
|
env:
|
|
ARCHITECTURES: ${{ inputs.architectures }}
|
|
run: |
|
|
set -euo pipefail
|
|
|
|
# Get available platforms from buildx
|
|
available_platforms=$(docker buildx ls | grep -o 'linux/[^ ]*' | sort -u | tr '\n' ',' | sed 's/,$//')
|
|
|
|
if [ -n "$available_platforms" ]; then
|
|
echo "platforms=${available_platforms}" >> $GITHUB_OUTPUT
|
|
echo "Detected platforms: ${available_platforms}"
|
|
else
|
|
echo "platforms=$ARCHITECTURES" >> $GITHUB_OUTPUT
|
|
echo "Using default platforms: $ARCHITECTURES"
|
|
fi
|
|
|
|
- name: Determine Image Name
|
|
id: image-name
|
|
shell: bash
|
|
env:
|
|
IMAGE_NAME: ${{ inputs.image-name }}
|
|
run: |
|
|
set -euo pipefail
|
|
|
|
if [ -z "$IMAGE_NAME" ]; then
|
|
repo_name=$(basename "${GITHUB_REPOSITORY}")
|
|
echo "name=${repo_name}" >> $GITHUB_OUTPUT
|
|
else
|
|
echo "name=$IMAGE_NAME" >> $GITHUB_OUTPUT
|
|
fi
|
|
|
|
- name: Parse Build Arguments
|
|
id: build-args
|
|
shell: bash
|
|
env:
|
|
BUILD_ARGS_INPUT: ${{ inputs.build-args }}
|
|
run: |
|
|
set -euo pipefail
|
|
|
|
args=""
|
|
if [ -n "$BUILD_ARGS_INPUT" ]; then
|
|
IFS=',' read -ra BUILD_ARGS <<< "$BUILD_ARGS_INPUT"
|
|
for arg in "${BUILD_ARGS[@]}"; do
|
|
args="$args --build-arg $arg"
|
|
done
|
|
fi
|
|
echo "args=${args}" >> $GITHUB_OUTPUT
|
|
|
|
- name: Parse Build Contexts
|
|
id: build-contexts
|
|
shell: bash
|
|
env:
|
|
BUILD_CONTEXTS: ${{ inputs.build-contexts }}
|
|
run: |
|
|
set -euo pipefail
|
|
|
|
contexts=""
|
|
if [ -n "$BUILD_CONTEXTS" ]; then
|
|
IFS=',' read -ra CONTEXTS <<< "$BUILD_CONTEXTS"
|
|
for ctx in "${CONTEXTS[@]}"; do
|
|
contexts="$contexts --build-context $ctx"
|
|
done
|
|
fi
|
|
echo "contexts=${contexts}" >> $GITHUB_OUTPUT
|
|
|
|
- name: Parse Secrets
|
|
id: secrets
|
|
shell: bash
|
|
env:
|
|
INPUT_SECRETS: ${{ inputs.secrets }}
|
|
run: |
|
|
set -euo pipefail
|
|
|
|
secrets=""
|
|
if [ -n "$INPUT_SECRETS" ]; then
|
|
IFS=',' read -ra SECRETS <<< "$INPUT_SECRETS"
|
|
for secret in "${SECRETS[@]}"; do
|
|
# Trim whitespace
|
|
secret=$(echo "$secret" | xargs)
|
|
|
|
if [[ "$secret" == *"="* ]]; then
|
|
# Parse id=src format
|
|
id="${secret%%=*}"
|
|
src="${secret#*=}"
|
|
|
|
# Validate id and src are not empty
|
|
if [[ -z "$id" || -z "$src" ]]; then
|
|
echo "::error::Invalid secret format: '$secret'. Expected 'id=src' where both id and src are non-empty"
|
|
exit 1
|
|
fi
|
|
|
|
secrets="$secrets --secret id=$id,src=$src"
|
|
else
|
|
# Handle legacy format - treat as id only (error for now)
|
|
echo "::error::Invalid secret format: '$secret'. Expected 'id=src' format for Buildx compatibility"
|
|
exit 1
|
|
fi
|
|
done
|
|
fi
|
|
echo "secrets=${secrets}" >> $GITHUB_OUTPUT
|
|
|
|
- name: Login to GitHub Container Registry
|
|
if: ${{ inputs.push == 'true' }}
|
|
uses: docker/login-action@5e57cd118135c172c3672efd75eb46360885c0ef # v3.6.0
|
|
with:
|
|
registry: ghcr.io
|
|
username: ${{ github.actor }}
|
|
password: ${{ inputs.token || github.token }}
|
|
|
|
- name: Set up Build Cache
|
|
id: cache
|
|
shell: bash
|
|
env:
|
|
CACHE_IMPORT: ${{ inputs.cache-import }}
|
|
CACHE_FROM: ${{ inputs.cache-from }}
|
|
CACHE_EXPORT: ${{ inputs.cache-export }}
|
|
PUSH: ${{ inputs.push }}
|
|
INPUT_TOKEN: ${{ inputs.token }}
|
|
CACHE_MODE: ${{ inputs.cache-mode }}
|
|
run: |
|
|
set -euo pipefail
|
|
|
|
# Use provided token or fall back to GITHUB_TOKEN
|
|
TOKEN="${INPUT_TOKEN:-${GITHUB_TOKEN:-}}"
|
|
|
|
cache_from=""
|
|
cache_to=""
|
|
|
|
# Handle cache import
|
|
if [ -n "$CACHE_IMPORT" ]; then
|
|
cache_from="--cache-from $CACHE_IMPORT"
|
|
elif [ -n "$CACHE_FROM" ]; then
|
|
cache_from="--cache-from $CACHE_FROM"
|
|
fi
|
|
|
|
# Handle cache export
|
|
if [ -n "$CACHE_EXPORT" ]; then
|
|
cache_to="--cache-to $CACHE_EXPORT"
|
|
fi
|
|
|
|
# Registry cache configuration for better performance (only if authenticated)
|
|
if [ "$PUSH" == "true" ] || [ -n "$TOKEN" ]; then
|
|
normalized_repo=$(echo "${GITHUB_REPOSITORY}" | tr '[:upper:]' '[:lower:]' | sed 's/[^a-z0-9._\/-]/-/g')
|
|
registry_cache_ref="ghcr.io/${normalized_repo}/cache:latest"
|
|
cache_from="$cache_from --cache-from type=registry,ref=$registry_cache_ref"
|
|
|
|
# Set cache mode
|
|
cache_mode="$CACHE_MODE"
|
|
if [ -z "$cache_to" ]; then
|
|
cache_to="--cache-to type=registry,ref=$registry_cache_ref,mode=${cache_mode}"
|
|
fi
|
|
fi
|
|
|
|
# Also include local cache as fallback
|
|
cache_from="$cache_from --cache-from type=local,src=/tmp/.buildx-cache"
|
|
if [[ "$cache_to" != *"type=local"* ]]; then
|
|
cache_to="$cache_to --cache-to type=local,dest=/tmp/.buildx-cache-new,mode=${cache_mode}"
|
|
fi
|
|
|
|
echo "from=${cache_from}" >> $GITHUB_OUTPUT
|
|
echo "to=${cache_to}" >> $GITHUB_OUTPUT
|
|
|
|
- name: Build Multi-Architecture Docker Image
|
|
id: build
|
|
shell: bash
|
|
env:
|
|
AUTO_DETECT_PLATFORMS: ${{ inputs.auto-detect-platforms }}
|
|
DETECTED_PLATFORMS: ${{ steps.detect-platforms.outputs.platforms }}
|
|
ARCHITECTURES: ${{ inputs.architectures }}
|
|
PUSH: ${{ inputs.push }}
|
|
DRY_RUN: ${{ inputs.dry-run }}
|
|
MAX_RETRIES: ${{ inputs.max-retries }}
|
|
VERBOSE: ${{ inputs.verbose }}
|
|
SBOM_FORMAT: ${{ inputs.sbom-format }}
|
|
IMAGE_NAME: ${{ steps.image-name.outputs.name }}
|
|
TAG: ${{ inputs.tag }}
|
|
BUILD_ARGS: ${{ steps.build-args.outputs.args }}
|
|
BUILD_CONTEXTS: ${{ steps.build-contexts.outputs.contexts }}
|
|
SECRETS: ${{ steps.secrets.outputs.secrets }}
|
|
CACHE_FROM: ${{ steps.cache.outputs.from }}
|
|
CACHE_TO: ${{ steps.cache.outputs.to }}
|
|
DOCKERFILE: ${{ inputs.dockerfile }}
|
|
CONTEXT: ${{ inputs.context }}
|
|
run: |
|
|
set -euo pipefail
|
|
|
|
# Track build start time
|
|
build_start=$(date +%s)
|
|
|
|
# Determine platforms to build
|
|
if [ "$AUTO_DETECT_PLATFORMS" == "true" ] && [ -n "$DETECTED_PLATFORMS" ]; then
|
|
platforms="$DETECTED_PLATFORMS"
|
|
else
|
|
platforms="$ARCHITECTURES"
|
|
fi
|
|
|
|
# For local load (push=false), restrict to single platform
|
|
if [ "$PUSH" != "true" ]; then
|
|
# Extract first platform only for local load
|
|
platforms=$(echo "$platforms" | cut -d',' -f1)
|
|
echo "Local build mode: restricting to single platform: $platforms"
|
|
fi
|
|
|
|
# Initialize platform matrix tracking
|
|
platform_matrix="{}"
|
|
|
|
# Check for dry run
|
|
if [ "$DRY_RUN" == "true" ]; then
|
|
echo "[DRY RUN] Would build for platforms: $platforms"
|
|
echo "digest=dry-run-no-digest" >> $GITHUB_OUTPUT
|
|
echo "platform-matrix={}" >> $GITHUB_OUTPUT
|
|
echo "build-time=0" >> $GITHUB_OUTPUT
|
|
exit 0
|
|
fi
|
|
|
|
attempt=1
|
|
max_attempts="$MAX_RETRIES"
|
|
|
|
# Prepare verbose flag
|
|
verbose_flag=""
|
|
if [ "$VERBOSE" == "true" ]; then
|
|
verbose_flag="--progress=plain"
|
|
fi
|
|
|
|
# Prepare SBOM options
|
|
sbom_flag="--sbom=true"
|
|
if [ -n "$SBOM_FORMAT" ]; then
|
|
sbom_flag="--sbom=true --sbom-format=$SBOM_FORMAT"
|
|
fi
|
|
|
|
while [ $attempt -le $max_attempts ]; do
|
|
echo "Build attempt $attempt of $max_attempts"
|
|
|
|
# Build command with platform restriction for local load
|
|
if [ "$PUSH" == "true" ]; then
|
|
build_action="--push"
|
|
else
|
|
build_action="--load"
|
|
fi
|
|
|
|
if docker buildx build \
|
|
--platform=${platforms} \
|
|
--tag "$IMAGE_NAME:$TAG" \
|
|
$BUILD_ARGS \
|
|
$BUILD_CONTEXTS \
|
|
$SECRETS \
|
|
$CACHE_FROM \
|
|
$CACHE_TO \
|
|
--file "$DOCKERFILE" \
|
|
${build_action} \
|
|
--provenance=true \
|
|
${sbom_flag} \
|
|
${verbose_flag} \
|
|
--metadata-file=/tmp/build-metadata.json \
|
|
"$CONTEXT"; then
|
|
|
|
# Get image digest
|
|
if [ "$PUSH" == "true" ]; then
|
|
digest=$(docker buildx imagetools inspect "$IMAGE_NAME:$TAG" --raw | jq -r '.digest // "unknown"' || echo "unknown")
|
|
else
|
|
digest=$(docker inspect "$IMAGE_NAME:$TAG" --format='{{.Id}}' || echo "unknown")
|
|
fi
|
|
echo "digest=${digest}" >> $GITHUB_OUTPUT
|
|
|
|
# Parse metadata
|
|
if [ -f /tmp/build-metadata.json ]; then
|
|
{
|
|
echo "metadata<<EOF"
|
|
cat /tmp/build-metadata.json
|
|
echo "EOF"
|
|
} >> "$GITHUB_OUTPUT"
|
|
|
|
# Extract SBOM location directly from file
|
|
sbom_location=$(jq -r '.sbom.location // ""' /tmp/build-metadata.json)
|
|
echo "sbom-location=${sbom_location}" >> "$GITHUB_OUTPUT"
|
|
fi
|
|
|
|
# Calculate build time
|
|
build_end=$(date +%s)
|
|
build_time=$((build_end - build_start))
|
|
echo "build-time=${build_time}" >> $GITHUB_OUTPUT
|
|
|
|
# Build platform matrix
|
|
IFS=',' read -ra PLATFORM_ARRAY <<< "${platforms}"
|
|
platform_matrix="{"
|
|
for p in "${PLATFORM_ARRAY[@]}"; do
|
|
platform_matrix="${platform_matrix}\"${p}\":\"success\","
|
|
done
|
|
platform_matrix="${platform_matrix%,}}"
|
|
echo "platform-matrix=${platform_matrix}" >> $GITHUB_OUTPUT
|
|
|
|
# Move cache
|
|
if [ -d /tmp/.buildx-cache-new ]; then
|
|
rm -rf /tmp/.buildx-cache
|
|
mv /tmp/.buildx-cache-new /tmp/.buildx-cache
|
|
fi
|
|
|
|
break
|
|
fi
|
|
|
|
attempt=$((attempt + 1))
|
|
if [ $attempt -le $max_attempts ]; then
|
|
echo "Build failed, waiting 10 seconds before retry..."
|
|
sleep 10
|
|
else
|
|
echo "::error::Build failed after $max_attempts attempts"
|
|
exit 1
|
|
fi
|
|
done
|
|
|
|
- name: Scan Image for Vulnerabilities
|
|
id: scan
|
|
if: inputs.scan-image == 'true' && inputs.dry-run != 'true'
|
|
uses: aquasecurity/trivy-action@b6643a29fecd7f34b3597bc6acb0a98b03d33ff8 # 0.33.1
|
|
with:
|
|
scan-type: 'image'
|
|
image-ref: ${{ steps.image-name.outputs.name }}:${{ inputs.tag }}
|
|
format: 'json'
|
|
output: 'trivy-results.json'
|
|
severity: 'HIGH,CRITICAL'
|
|
|
|
- name: Process Scan Results
|
|
id: scan-output
|
|
if: inputs.scan-image == 'true' && inputs.dry-run != 'true'
|
|
shell: bash
|
|
run: |
|
|
set -euo pipefail
|
|
|
|
# Read and format scan results for output
|
|
scan_results=$(cat trivy-results.json | jq -c '.')
|
|
echo "results=${scan_results}" >> $GITHUB_OUTPUT
|
|
|
|
# Check for critical vulnerabilities
|
|
critical_count=$(cat trivy-results.json | jq '.Results[] | (.Vulnerabilities // [])[] | select(.Severity == "CRITICAL") | .VulnerabilityID' | wc -l)
|
|
if [ "$critical_count" -gt 0 ]; then
|
|
echo "::warning::Found $critical_count critical vulnerabilities in image"
|
|
fi
|
|
|
|
- name: Install Cosign
|
|
if: inputs.sign-image == 'true' && inputs.push == 'true' && inputs.dry-run != 'true'
|
|
uses: sigstore/cosign-installer@d7543c93d881b35a8faa02e8e3605f69b7a1ce62 # v3.10.0
|
|
|
|
- name: Sign Image
|
|
id: sign
|
|
if: inputs.sign-image == 'true' && inputs.push == 'true' && inputs.dry-run != 'true'
|
|
shell: bash
|
|
env:
|
|
IMAGE_NAME: ${{ steps.image-name.outputs.name }}
|
|
IMAGE_TAG: ${{ inputs.tag }}
|
|
run: |
|
|
set -euo pipefail
|
|
|
|
# Sign the image (using keyless signing with OIDC)
|
|
export COSIGN_EXPERIMENTAL=1
|
|
cosign sign --yes "${IMAGE_NAME}:${IMAGE_TAG}"
|
|
|
|
echo "signature=signed" >> $GITHUB_OUTPUT
|
|
|
|
- name: Verify Build
|
|
id: verify
|
|
if: inputs.dry-run != 'true'
|
|
shell: bash
|
|
env:
|
|
PUSH: ${{ inputs.push }}
|
|
IMAGE_NAME: ${{ steps.image-name.outputs.name }}
|
|
IMAGE_TAG: ${{ inputs.tag }}
|
|
run: |
|
|
set -euo pipefail
|
|
|
|
# Verify image exists
|
|
if [ "$PUSH" == "true" ]; then
|
|
if ! docker buildx imagetools inspect "${IMAGE_NAME}:${IMAGE_TAG}" >/dev/null 2>&1; then
|
|
echo "::error::Built image not found"
|
|
exit 1
|
|
fi
|
|
|
|
# Get and verify platform support
|
|
platforms=$(docker buildx imagetools inspect "${IMAGE_NAME}:${IMAGE_TAG}" | grep "Platform:" | cut -d' ' -f2)
|
|
echo "built=${platforms}" >> $GITHUB_OUTPUT
|
|
else
|
|
# For local builds, just verify it exists
|
|
if ! docker image inspect "${IMAGE_NAME}:${IMAGE_TAG}" >/dev/null 2>&1; then
|
|
echo "::error::Built image not found locally"
|
|
exit 1
|
|
fi
|
|
echo "built=local" >> $GITHUB_OUTPUT
|
|
fi
|
|
|
|
- name: Cleanup
|
|
if: always()
|
|
shell: bash
|
|
run: |-
|
|
set -euo pipefail
|
|
|
|
# Cleanup temporary files
|
|
rm -rf /tmp/.buildx-cache*
|
|
|
|
# Remove builder instance if created
|
|
if docker buildx ls | grep -q builder; then
|
|
docker buildx rm builder || true
|
|
fi
|