concourse v6.5.0 Release Notes

Release Date: 2020-08-21 // over 3 years ago
  • ๐Ÿฑ ๐Ÿšจ Breaking

    ๐Ÿฑ Generate opaque OAuth2 access tokens (#5897) @aoldershaw ๐Ÿ”—

    • There were several issues that users encountered (particularly after v6.1.0) as a result of long access tokens. Concourse now generates much shorter access tokens rather than using the raw user data.
    • Users' last activity is now tracked on login rather than on every request. Updating the last activity on every request caused database problems at scale. Note: last activity is only relevant to fly active-users

    - This is only a breaking change for any custom automation built around Concourse that authenticates with the Concourse API

    ๐Ÿ›  Fix Gitlab auth to reference a user's username instead of their full name (#5925) @chenbh ๐Ÿ”—

    - If a team was configured for Gitlab auth with the --gitlab-user flag, you must ensure the user referenced is a valid Gitlab username, rather than a user's full name. If not, you must reconfigure the team with fly set-team to reference the username. Teams configured with --gitlab-group are unaffected.

    โž• Add format: trim to load_var step and make it the default (#5894) @evanchaoli ๐Ÿ”—

    • format: trim removes all trailing and leading whitespace from the input file

    - The prior behavior of keeping all whitespace can be used by specifying format: raw (see load_var.format)

    ๐Ÿฑ Prefix containerd specific flags with CONCOURSE_CONTAINERD (#5911) @muntac ๐Ÿ”—

    • This is only a breaking change if you were using the experimental containerd backend. The default guardian backend remains unaffected and is still configured with CONCOURSE_GARDEN environment variables

    ๐Ÿฑ โœˆ๏ธ Features

    ๐Ÿฑ Display favorite pipelines section at the top of the dashboard (#5922) @zoetian ๐Ÿ”—

    ๐Ÿฑ Pipelines can be favorited from the sidebar (#5860) @zoetian ๐Ÿ”—

    ๐Ÿฑ Pipelines can be favorited from the dashboard (#5904) @zoetian ๐Ÿ”—

    ๐Ÿฑ Pipelines can be favorited from the pipeline page (#5979) @zoetian ๐Ÿ”—

    ๐Ÿฑ Automatically archive abandoned pipelines (#5854) @taylorsilva ๐Ÿ”—

    • An abandoned pipeline is one that was once set by a set_pipeline step but no longer is. See the set_pipeline docs for more information

    - The temporary feature flag --enable-archive-pipeline was removed as the archiving pipelines feature is complete

    โž• Add experimental across step for running build plans across a matrix of values (#5887) @aoldershaw ๐Ÿ”—

    • This feature must be enabled using --enable-across-step as it is subject to change - don't be alarmed if your pipelines with across stop working in a future release!

    - There's no official documentation yet, but there are some examples of usage patterns in the RFC

    ๐Ÿ‘ Allow dot and colon in variable path (#5898) @xtremerui ๐Ÿ”—

    • You can now interpolate variables with special characters . and : in the name by wrapping them in double quotes

    - e.g. (("some.secret".field1)) accesses field1 of the secret some.secret

    ๐Ÿฑ Emit warnings for invalid identifiers (#5864) @mouellet ๐Ÿ”—

    • A warning will be emitted for every identifier that doesn't match the validation rules described in the identifier schema

    - After 1 year, we will error when identifiers don't match the validation rules - so, we recommend adhering to the new validation as soon as possible!

    ๐Ÿ‘Œ Support set-pipeline: self for configuring current pipeline (#5737) @evanchaoli ๐Ÿ”—

    - This feature is experimental, and may be removed a future version

    ๐Ÿ— Rerun builds with baggageclaim network errors (#5958) @kirillbilchenko ๐Ÿ”—

    • The --enable-rerun-when-worker-disappears flag now supports rerunning builds after any network error from the ATC to the worker's baggageclaim. Such network errors are common when the worker disappears.

    - Builds will now be rerun when this flag is enabled and the failing step is a nested step (e.g. within an in_parallel)

    ๐Ÿฑ Mount Btrfs loopback with discard option (#5916) @muntac ๐Ÿ”—

    - This punches holes in the underlying loop file making it sparse, and will potentially result in better disk utilization

    ๐Ÿ— Speed up querying for unencrypted builds (#5902) @clarafu ๐Ÿ”—

    - If your environment had a large number of builds and an encrypted database, you might have noticed your web node being slow to start up. An index was added to help speed up the querying of unencrypted builds which is run during the web startup.

    ๐Ÿ‘Œ Support reloading TSA worker keys via SIGHUP signal (#5652) @gaelL ๐Ÿ”—

    ๐Ÿ— get/put/task steps now emit the selected worker to the build log (#5846) @evanchaoli ๐Ÿ”—

    - The build log page and fly watch now display the worker name for get/put/task steps

    โœจ Enhance TasksWaiting metric to include teamId, workerTags, and platform labels (#5981) @aledeganopix4d ๐Ÿ”—

    โž• Add the token text to the fly_success page (#4951) @jvshahid ๐Ÿ”—

    ๐Ÿ”ง TSA's garden client timeout can be configured using --tsa-garden-request-timeout (#5845) @xtreme-sameer-vohra ๐Ÿ”—

    ๐Ÿ‘ Allow fly set-pipeline to take configuration from stdin (#5861) @evanchaoli ๐Ÿ”—

    - The --config flag of the fly set-pipeline command now supports - for reading pipeline config from stdin

    โž• Add --team flag to fly pause-pipeline and fly hide-pipeline commands (#5917) @owenfarrell ๐Ÿ”—

    โž• Add --team flag to fly destroy-pipeline command (#5924) @khng ๐Ÿ”—

    ๐Ÿฑ Always print warning after fly set-pipeline if pipeline is paused (#5883) @agurney ๐Ÿ”—

    โž• Add flag --ignore-event-parsing-errors to fly watch to ignore event parsing errors when an unknown event type or version is encountered. (#5957) @xtreme-sameer-vohra ๐Ÿ”—

    โœ‚ Remove unnecessary updates to the resource's check_error value (#5990) @clarafu ๐Ÿ”—

    - The query will only update the resource check error to NULL if it is not already NULL.

    ๐Ÿ‘Œ Support max container limit with containerd backend (#5836) @xtreme-sameer-vohra ๐Ÿ”—

    ๐Ÿฑ ๐Ÿž Bug Fixes

    ๐Ÿฑ Prevent potential database deadlock after pipeline deletion (#5987) @aoldershaw ๐Ÿ”—

    ๐Ÿ‘ Allow usage of images from custom resource types in fly execute (#5866) @jvshahid ๐Ÿ”—

    Save job.disable_manual_trigger to the database (#5908) @jamieklassen ๐Ÿ”—

    - Fixed the disable_manual_trigger: field on jobs -- since v6.0.0 it had no effect and jobs with this setting could actually still be manually triggered.

    ๐Ÿฑ Return error when a step only contains modifiers (#5910) @taylorsilva ๐Ÿ”—

    โฌ†๏ธ Bump baggageclaim to v1.8.0 to fix deeply-nested volumes with overlay driver (#5961) @vito ๐Ÿ”—

    ๐Ÿฑ ๐Ÿคท No Impact

    ๐Ÿš€ Edit pr template to include new release note generation process (#5903) @clarafu ๐Ÿ”—

    ๐Ÿ›  Fix flakey container sweeper test (#5923) @xtreme-vikram-yadav ๐Ÿ”—

    ๐Ÿฑ Elm tests use Data module for identifiers (#5928) @aoldershaw ๐Ÿ”—

    โœ‚ Remove ignored windows fly test case (#5946) @aoldershaw ๐Ÿ”—

    โœ‚ Remove private_plan from index (#5950) @izabelacg ๐Ÿ”—

    ๐Ÿฑ Prevent pipeline from getting GC'd in testflight (#5951) @aoldershaw ๐Ÿ”—

    ๐Ÿฑ Fly commands don't assume tokens are JWTs (#5955) @aoldershaw ๐Ÿ”—

    ๐Ÿฑ Use access token for Concourse API in topgun (#5965) @aoldershaw ๐Ÿ”—

    ๐Ÿฑ Deflake metrics tests (#5975) @jamieklassen ๐Ÿ”—

    ๐Ÿ”ง Skip failing k8s topgun tests for containerd without a dns proxy or dns servers configured (#5976) @xtreme-sameer-vohra ๐Ÿ”—

    ๐Ÿ›  Fix go 1.15 int-to-string conversion warning in tests (#5983) @aoldershaw ๐Ÿ”—

    ๐Ÿ— build(deps): bump lodash from 4.17.15 to 4.17.19 in /web/wats (#5890) @dependabot ๐Ÿ”—

    ๐Ÿ— build(deps): bump elliptic from 6.5.2 to 6.5.3 (#5940) @dependabot ๐Ÿ”—