Code quality binary

fix: use shorter names for default pool and local workers

Also
- updates `queue ls` to show only main queue items by default. Now `queue ls all` will show everything.
- fixes `queue ls` as it was only showing items from first step

Signed-off-by: Nick Mitchell <[email protected]>

v0.27.0

What's Changed

• fix:target=ibmcloud components workstealer and workdispatcher default sa not found by @aavarghese in #225
• feat: port tests/bin/helpers.sh from kubectl logs to lunchpail logs by @starpit in #227
• feat: runs command and update helpers.sh to use it by @starpit in #228
• test: remove unused local queue= shell variable in tests/bin/helpers.sh by @starpit in #230
• test: eliminate unused waitForStatus in helpers.sh by @starpit in #232
• test: update the second run_name= in helpers.sh by @starpit in #233
• test: eliminate watch from helpers.sh by @starpit in #234
• test: eliminate unnecessary kubectl waits from helper.sh by @starpit in #235
• feat: lunchpail run instances by @starpit in #236
• test: update test7 validator to expect 6 output files by @starpit in #237
• feat: qls and qcat in compiled mode by @starpit in #238
• test: isolate securityContext tests into test7-security-context by @starpit in #239
• feat: update qin to support running in compiled mode by @starpit in #240
• fix: eliminate rclone CLI dependence from tests by @starpit in #241
• feat: do away with hack/init by having be/kubernetes.Ok() prompt to create cluster by @starpit in #242
• fix: update kubernetes ListRuns to look for pods not jobs by @starpit in #243
• fix: remove leftover debug comments by @starpit in #244
• fix: minio server command sleeps twice before exit by @starpit in #245
• feat: lunchpail copyout by @starpit in #246
• feat: move copyout impl from be/kubernetes into fe/transformer by @starpit in #247
• fix: job parallelism for all VSIs together can be more than requested worker bug by @aavarghese in #248
• fix: front-end has kubernetes-specific queue endpoint (service address) by @starpit in #251
• fix: remove leftover debug output by @starpit in #250
• fix: avoid kubernetes-isms in test rclone config by @starpit in #252
• fix: ibmcloud be should delete cloud resources for multiple runs by @aavarghese in #253
• fix: remove leftover debug output by @starpit in #255
• fix: s3 DownloadFile should wait for bucket to exist by @starpit in #254
• fix: avoid /workdir absolute path in qout call by @starpit in #256
• refactor: pull out common parts of qstat streaming by @starpit in #257
• feat: update qstat streamer to support line channels by @starpit in #258
• feat: local backend by @starpit in #223
• feat: --run option and run list --all option by @starpit in #259
• fix: avoid using fixed in-pod (or process) port 9000 for minio by @starpit in #260
• feat: allow --target to be provided at compile time by @starpit in #261
• fix: pass through context to streamer APIs by @starpit in #262
• fix: update backend.Up/Down to pass through context by @starpit in #263
• fix: avoid context.TODO() in pkg/be/kubernetes by @starpit in #265
• fix: ListRuns/Singleton/WaitForRun should require a context by @starpit in #266
• fix: remove unintended context.Background remnant in be/kubernetes by @starpit in #267
• fix: compiler.Compile should accept a context by @starpit in #268
• fix: backend.Queue should accept a context by @starpit in #269
• fix: pkg/runtime/queue funcs should accept a context by @starpit in #270
• fix: backend.InstanceCount() should accept a context by @starpit in #271
• fix: ChangeWorkers should accept a context by @starpit in #272
• fix: backend.Ok() should accept a context by @starpit in #273
• test: add test to validate that pkg/ is free of context.Background/TODO by @starpit in #274
• fix: adding verbose + debug flags by @aavarghese in #276
• fix: auto-disable watch mode if stdout is not a tty by @starpit in #275
• fix: removing verbose as parameter and use compilationOptions by @aavarghese in #277
• fix: unknown --verbose in lunchpail enqueue file by @aavarghese in #279
• chore: bump charmbracelet (status ui) dependencies by @starpit in #280
• Fix code scanning alert #2: Incorrect conversion between integer types by @starpit in #282
• fix: down with kubernetes target does not clean up done runs by @starpit in #283
• fix: removing verbose as parameter and use compilationOptions cont.. by @aavarghese in #278
• fix: support minio component logs by @aavarghese in #285
• fix: clean up minio server code by @starpit in #284
• fix: implement RunComponentUpdates for local backend by @starpit in #286
• fix: restore target/log options from compile time by @aavarghese in #287
• fix: update streamer.RunComponentUpdates() to put caller in charge of channels and goroutines by @starpit in #288
• fix: remove some remnants of namespace in pkg/observe by @starpit in #290
• fix: workerpool InstanceName should include run name by @starpit in #289
• fix: restore original pool name label by @starpit in #293
• fix: Streamer.QueueStats() api should place caller in control of goroutines and channels by @starpit in #292
• test: reduce verbosity of test output vs logs by @starpit in #291
• fix: Streamer.Utilization() should place caller in charge of goroutines and channels by @starpit in #294
• fix: kube utilization streamer may send on closed channel by @starpit in #295
• fix: add another s3 retry for 'Server not initialized yet' by @starpit in #297
• fix: local run list --all does not show all runs by @starpit in #298
• feat: simplify up to stream logs only (for now) by @starpit in #296
• feat: add component prefix to log line output by @starpit in #299
• fix: parametersweep dispatcher has two printenvs by @starpit in #300
• fix: clean up parametersweep output, e.g. echo -n shows -n by @starpit in #301
• feat: add Utilization impl to local backend by @starpit in #302
• test: add test-python by @starpit in #303
• fix: boot/up without watch results in hanging channel send by @starpit in #304
• fix: local run instances does not check if pids are still running by @starpit in #305
• refactor: rename test-python to python-basic by @starpit in #307
• test: update wait-to-die validators to pass current run name to instance count by @starpit in #306
• refactor: eliminate linker.ConfigureOptions by @starpit in #308
• refactor: eliminate fe.CompileOptions by @starpit in #309
• refactor: clean up linker.Configure API to remove unneeded args and returns by @starpit in #310
• refactor: no need to return compilation options from PrepareForRun by @starpit in #311
• refactor: simply boot/up,down by avoiding needless reuse by @starpit in #312
• fix: remove lingering UpOptions.UseThisRunName by @starpit in #313
• chore: code cleanup and comments for prepare-run by @starpit in #315
• refactor: rename hlir.AppModel -> hlir.HLIR by @starpit in #316
• feat: update runtime/queue/CopyIn to accept an array of files/paths to copy in by @starpit in #317
• feat: update runtime/queue.CopyIn to support copying ...

v0.26.0

What's Changed

• feat: begin update llir to be kubernetes-agnostic by @starpit in #182
• fix: up subcommand positional argument validation by @starpit in #185
• feat: a bit more lunchpail.xxx namespacing of lunchpail-provided template values by @starpit in #186
• refactor: shift helm values for shell component out of fe and into be/kubernetes by @starpit in #188
• fix: metadata ns should not be specified in template, only during apply by @aavarghese in #189
• fix: set ns in llir by @aavarghese in #190
• fix: cloud-init cmd to include ns with apply by @aavarghese in #191
• refactor: move kubernetes common chart into be/kubernetes by @starpit in #195
• refactor: move kubernetes-specific functions into pkg/be/kubernetes out of pkg/fe/transformer by @starpit in #196
• refactor: move pkg/fe/template to pkg/be/helm by @starpit in #197
• fix: avoid creating multiple workstealers by @starpit in #198
• refactor: eliminate use of namespace from transformer by @starpit in #199
• refactor: split out be.New logic into separate file by @starpit in #200
• refactor: move remnants of be/delegation into be.Backend interface by @starpit in #201
• chore: reduce docker image size by @starpit in #202
• fix: trim more from the image builds by @starpit in #203
• feat: log qstat info to a file in the queue folder by @starpit in #109
• refactor: move qstat and utilization streamer kubernetes logic into backend by @starpit in #204
• fix: stabilize tests by @starpit in #206
• refactor: move kubernetes logic from pkg/observe/logs into pkg/be by @starpit in #205
• fix: more shrinking of binary by @starpit in #207
• refactor: remove unused backend variable from pkg/fe by @starpit in #208
• refactor: pkg/be/platform -> pkg/be/options by @starpit in #209
• refactor: rename backend.DeleteNamespace() to backend.Purge() by @starpit in #210
• feat: introduce backend.DryRun by @starpit in #211
• fix: make namespace field private in kubernetes backend by @starpit in #212
• fix: simplify the way we trim out the backend by @starpit in #213
• fix: remove some lingering "appname" variables scattered throughout by @starpit in #214
• fix: shift +/- does not change pool size by @starpit in #215
• fix: remove superfluous Runname from Linked struct by @starpit in #216
• fix: remove superfluous ir.Linked struct altogether by @starpit in #217
• fix: simplify/consolidate opts in the backend by @starpit in #218
• fix: -t/--target parameter has no effect by @starpit in #220
• fix: further simplify options in backend by having llir.Options by @starpit in #219
• fix: no minio component with external s3 by @aavarghese in #221
• feat: port minio.sh to lunchpail minio server by @starpit in #224

Full Changelog: v0.25.0...v0.26.0

v0.25.0

What's Changed

• fix: only create and use service account if needed by @starpit in #159
• feat: update minio component to transpile to shell by @starpit in #162
• refactor: update workstealer to transpile to shell (remove charts/workstealer) by @starpit in #163
• fix: add sleep before exit in minio and terminationGracePeriodSeconds when running tests by @starpit in #164
• feat: Port workerpool to transpile to shell by @starpit in #165
• fix: remove unnecessary charts/values.yaml and charts/requirements.lock by @starpit in #166
• refactor: move charts/shell into pkg/ by @starpit in #167
• fix: add field comments to ApplicationInstanceSpec by @starpit in #168
• refactor: more charts/ into pkg/fe/template/chart by @starpit in #169
• refactor: move images/base-images into docs/base-images by @starpit in #170
• chore: remove old commented code in workerpool/lower by @starpit in #171
• fix: remove unnecessarily duplicated RemoveAll of transformer template by @starpit in #172
• chore: remove unused template values in configure.go by @starpit in #173
• fix: up --create-namespace regression by @starpit in #174
• fix: regression base chart.tar.gz may not get updated by @starpit in #175
• refactor: further simplify template values in configure.go by @starpit in #176
• feat: pass through yaml values to transformer by @starpit in #177
• feat: remove Values.enclosingRun by @starpit in #178
• refactor: rename ApplicationInstanceSpec -> ShellSpec by @starpit in #180
• chore: cleanup same tests, and spread to another layer by @aavarghese in #181
• chore: bump to 0.25.0 by @starpit in #179

Full Changelog: v0.24.0...v0.25.0

v0.24.0

What's Changed

• feat: internal s3 in a separate component by @aavarghese in #142
• feat: lunchpail enqueue file --wait by @starpit in #143
• fix: remove remnants of internal s3 from workstealer chart by @starpit in #144
• feat: update minio chart to use minio image directly by @starpit in #147
• fix: remove unused Secret from workerpool chart by @starpit in #150
• feat: minio container self-destruct when run finishes by @starpit in #149
• fix: restructure Dockerfile to avoid proliferation of 1.8Gi image build layers by @starpit in #152
• fix: remove unused queue-related volume/volumeMounts from workerpool chart by @starpit in #151
• fix: remove more remnants of old workdir logic from charts by @starpit in #153
• fix: skip empty env with lowering to llir by @starpit in #154
• fix: simplify charts/shell env by removing configmap by @starpit in #155
• fix: simplify charts/workerpool env by removing configmap by @starpit in #156
• fix: remove old 'run as root' bits from charts by @starpit in #158
• fix: more work on optimizing proliferation of docker layers by @starpit in #157
• feat: enqueue --wait returns task exit code by @aavarghese in #148
• chore: bump to 0.24.0 by @aavarghese in #161

Full Changelog: v0.23.0...v0.24.0

v0.23.0

What's Changed

• fix: clean up handling of queue paths by @starpit in #101
• chore: bump workstealer/worker-watcher golang 1.22.1 -> 1.22.6 by @starpit in #102
• chore: bump golang 1.22.1 -> 1.22.6 by @starpit in #103
• chore: update issue templates by @aavarghese in #105
• chore: refactor assemble terminology to compile by @aavarghese in #108
• feat: remove support for Application repo field and PlatformRepoSecret by @starpit in #111
• chore: remove lunchpail-workdir image by @starpit in #112
• chore: remove untested lunchpail-tasksimulator-parquet image by @starpit in #113
• chore: remove unused python-alpine component image by @aavarghese in #114
• feat: use alpine:3 as the default Application image by @starpit in #115
• feat: update workstealer image to use alpine rather than debian slim by @starpit in #117
• feat: pull worker-watcher into main lunchpail binary by @starpit in #116
• feat: port workstealer.sh to go by @starpit in #118
• refactor: move workstealer out of its own image into pkg/runtime/workstealer by @starpit in #119
• doc: remove reference to old 'images/components' by @starpit in #120
• refactor: rename copyin.go -> qin.go by @starpit in #121
• feat: lunchpail enqueue commands by @starpit in #122
• chore: purge remnants of bash-based workerpool watcher by @starpit in #123
• chore: clean out prestop shell script in charts/shell by @starpit in #124
• chore: remove unused tests/base-images by @starpit in #125
• chore: remove unused ibmcloud create_vm by @starpit in #126
• chore: remove unused tests/bin/mc.sh by @starpit in #127
• chore: remove unused tests/bin/s3-copyin by @starpit in #128
• chore: remove now-unused lunchpail-rclone base image by @starpit in #129
• refactor: introduce hlir.NewApplication()` by @starpit in #130
• refactor: move runtime queue logic into pkg/runtime/queue by @starpit in #131
• fix: retry s3 on i/o timeout by @starpit in #132
• chore: remove vestiges of AppWrapper from workstealer chart by @starpit in #133
• chore: remove vestiges of AppWrapper from shell chart by @starpit in #134
• chore: remove vestiges of AppWrapper from workerpool chart by @starpit in #135
• fix: remove last use of LUNCHPAIL_RUN_NAME env var from workers by @starpit in #136
• fix: remove a few env vars by @starpit in #137
• fix: remove a few more env vars by @starpit in #140
• chore: bump to 0.23.0 by @starpit in #141

Full Changelog: v0.22.0...v0.23.0

v0.22.0

What's Changed

• doc: update README badge link to reflect actions.yml -> tests.yml workflow change by @starpit in #51
• doc: update demo docs to reflect --create-namespace changes by @starpit in #52
• doc: add gif to readme by @starpit in #53
• doc: add descriptions for images/gifs by @starpit in #54
• doc: leverage github's support for Notes rendering by @starpit in #55
• doc: tweak readme image sizes by @starpit in #56
• doc: split out user roles from main readme by @starpit in #57
• doc: add usage and example to build readme by @starpit in #58
• docs: restructure into docs/architecture by @starpit in #59
• feat: allow backend to provide values to linker.Configure, and do so to infer ClusterIsOpenShift by @starpit in #60
• chore: bump IBM/go-sdk-core v4 -> v5 by @starpit in #61
• feat: up --target-platform/-p -> --target/-t by @starpit in #62
• feat: down --target-platform/-p -> --target/-t by @starpit in #64
• fix: casing for target deployment types by @aavarghese in #66
• feat: support bearer token auth for ibmcloud target by @starpit in #67
• feat: looping for cluster ready check by @aavarghese in #70
• fix: overriding global type for openshift clusters by @aavarghese in #71
• feat: log creation times for ibmcloud backend by @starpit in #73
• feat: parallelize ibmcloud VSI creation calls by @starpit in #75
• feat: using randomized zone from region discovery by @aavarghese in #74
• feat: add username to runname by @aavarghese in #76
• feat: allow for re-assembly i.e. assemble against an assembled binary by @starpit in #78
• refactor: introduce interface-based Backend by @starpit in #79
• fix: clean up default-queue secret by @starpit in #80
• fix: clean up workstealer queue variables by @starpit in #81
• fix: begin consolidation of queue prefix path logic by @starpit in #82
• fix: continue consolidate of queue variables by @starpit in #83
• fix: disallow kubernetes api access from our pods by @starpit in #85
• fix: clean up workerpool and shell queue variables by @starpit in #84
• doc: flesh out docs/contribute/README.md by @starpit in #87
• fix: ipv6 address should not fail security group creation by @aavarghese in #88
• doc: clarify up versus down in demo docs by @starpit in #90
• doc: place conventional commits in TIP block by @starpit in #91
• doc: make top-level README consistent with doc/demos in naming of binaries by @starpit in #92
• fix: be interface missing assemble option for apikey, random zone only if config resouregroup exists by @aavarghese in #93
• feat: remove unnecessary api: field of Application by @starpit in #95
• doc: fix typo in docs/contribute by @starpit in #96
• feat: discover existing sshkey from userdir for ibmcloud be, reuse existing sshkey resource if exists by @aavarghese in #89
• feat: add support for --set-file by @starpit in #97
• fix: set apikey for cloud authenticator with down cmd by @aavarghese in #98
• fix: status UI fails to show task cells for workers by @starpit in #99
• chore: bump to 0.22.0 by @starpit in #100

Full Changelog: v0.21.2...v0.22.0

0.21.2

What's Changed

• doc: improve demo download wording and links a bit by @starpit in #34
• chore: add LICENSE file by @starpit in #33
• doc: tweak and tighten intro by @starpit in #35
• chore: remove outdated architecture image by @starpit in #36
• doc: add screenshots to readme by @starpit in #37
• doc: split up README into docs/demos docs/build docs/contribute by @starpit in #38
• doc: add OpenROAD demo to demos README by @starpit in #39
• test: tests should run up --no-watch by @starpit in #42
• feat: be.Ok() API and update up() to use it as a prereq by @starpit in #41
• fix: update internal minio service name to include 'lunchpail' by @starpit in #43
• fix: fully-qualify alpine:3 -> docker.io/alpine:3 by @starpit in #44
• test: remove outdated test6b by @starpit in #45
• test: split out test7* into two workflows for github actions by @starpit in #46
• fix: disable internal s3 for remote cos by @aavarghese in #40
• fix: wait before kubectl apply, platform type, vsi(s) per component, etc by @aavarghese in #7
• feat: allow --create-namespace to be specified at assembly time by @starpit in #47
• chore: bump go module versions by @starpit in #48
• chore: rename github action test workflow actions.yml -> tests.yml by @starpit in #50
• chore: bump to 0.21.2 by @starpit in #49

New Contributors

• @aavarghese made their first contribution in #40

Full Changelog: v0.21.1...v0.21.2

0.21.1

What's Changed

• fix: update two go.mod to point to new repo by @starpit in #11
• test: remove archived tests by @starpit in #12
• fix: update comment to use public github by @starpit in #13
• feat: add --all-platforms/-A option to assemble by @starpit in #14
• feat: allow app to pass through app version by @starpit in #15
• doc: add release badge to readme by @starpit in #16
• doc: update readme to remove outdated info by @starpit in #17
• doc: update readme to point to latest lunchpail-demo release by @starpit in #18
• feat: version command should show both app version and lunchpail version by @starpit in #29
• feat: improve local UX with up --create-cluster and --watch by default by @starpit in #20
• fix: status UI hangs with a blank screen; shows no pool updates by @starpit in #31
• chore: bump to 0.21.1 by @starpit in #32

Full Changelog: v0.21.0...v0.21.1

0.21.0

First public release