Skip to content

Releases: codalab/codalab-worksheets

Version 0.5.17 (July 14, 2020)

14 Jul 19:16
f005e2d
Compare
Choose a tag to compare

Frontend:
Fix some frontend build warnings (#2500) …
give record items sort key (#2519)
Add new run, text, upload above the first item when no focus (#2520) …

Backend:
Prettier CLI Reference: remove end colon for each single command (#2462)
Improve monitor script when sending worker offline alert (#2503) …
Add --worker-pass-down-termination flag to WorkerManager (#2508)
Create SECURITY.md (#2501) …
expect failure for infinite memory tests (#2507) …
Re-create missing docker networks before launching containers (#2468)
Fix state transition in finalizing worker run state (#2451) …
Don't limit workermanager search by provided tags (#2506) …
Handle simultaneous image deletion in DockerImageManager (#2444)
Remove encoding and decoding (#2512) …
Enable customizing the cl-worker executable used in the WorkerManager (… …
fix heartbeat (#2516)
Set default value of exit_after_num_runs to maxint in rest API call
Make WorkerManagers sleep on JsonApiException (#2523)
CI: Remove some parallelism (#2478) …
Replace vertical bar with space for OR relation (#2524) …
Handle OCI runtime failure due to insufficient memory (#2525) …
Run nvidia-smi directly on worker host to respect GPU isolation (#2415)
Don't try to start bundles on offline / timed-out workers (#2424)
Don't filter workermanager to current user's staged bundles if user i… …
Minimize intermediate state transition for bundle manager (#2438) …
Add --worker-tag-exclusive to WorkerManager (#2564)
Enable filtering jobs in the AWSBatchWorkerManager (#2565) …
Increase minimum memory (#2579)

Version 0.5.16 (June 29, 2020)

29 Jun 21:59
Compare
Choose a tag to compare

Frontend

  • Rename actionbar => terminal (#2429)
  • Remove select all for table (#2428)
  • Remove detach from the frontend (#2427)
  • Fix showing file contents for record item (#2455)

Backend

  • Fix SlurmWorkerManager overlaunching (#2391)
  • Fix accessing worker information from WorkerInfoAccessor (#2419)
  • Don't fail WorkerManager if a network exception is encountered (#2422)
  • Add exit-after-num-runs=1 to slurm worker manager (#2373)
  • Fix invalid datetime and missing created field in metadata object (#2475)
  • Fix scontrol state parsing regex in SlurmWorkerManager (#2484)
  • Enable workers to exit on exceptions, instead of sleeping (#2467)

Docs / tests / CI

Version 0.5.15 (June 4, 2020)

16 Jun 10:10
Compare
Choose a tag to compare

Backend

  • Fix grammar and minimize parameter passed to function construct_run_message (#2177)
  • Allow CPU workers rank higher for CPU only jobs (#2166)
  • Add flag to cl download to force overwriting of downloads (#2189)
  • Fix wadd across different instances (#2198)
  • Fix tailing cl wait output (#2199)
  • Using physical cores when calculating available CPUs on any platforms (#2196)
  • Add more information on default limit number of search results (#2200)
  • Making info properties clear (#2145)
  • Fix wadd across instances (#2211)
  • Add memoize option to cl run and mimic (#2159)
  • Remove test as -s argument (#2146)
  • Add apex to default-gpu docker image (#2218)
  • Update default-cpu Dockerfile to match default-gpu (#2231)
  • Fix time quota calculation (#2236)
  • Prevent creating ._ files when zipping for upload (#2239)
  • Fix copy test (#2173)
  • Set the version of python-dateutil to 2.8.1 (#2259)
  • Test that bundles are ready after performing wadd across instances (#2265)
  • Respect bundle priority by precomputing available workers during scheduling (#2257)
  • Do not return if the metadata of bundle contents cannot be found (#2267)
  • Fix broken cl edit due to encoding (#2241)
  • Fix terminate loop (#2292)
  • Move terminated bundle from worker back to staged state (#2186)
  • More resource allocation options for AWS Batch Worker Manager (#2306)
  • Don't duplicate sort keys for the same bundle items (#2321)
  • Only show staged bundles from current user in WorkerManager (#2314)
  • Add flag to cleanup worker work-dir upon exit (#2313)
  • Add --worker-work-dir-prefix to WorkerManager (#2312)
  • Slurm worker manager (#2279)
  • Load jobs by partition in SlurmWorkerManager (#2345)
  • Fix logging of active workers in SlurmWorkerManager (#2343)
  • Add nicer error message when running workermanager w/o boto3 (#2331)
  • Add container existence check (#2337)
  • Remove extant output directories when force-downloading bundles (#2342)
  • Fix intermittent failures for search_time test module (#2352)
  • Do not wadd bundles in non terminal states (#2317)
  • Enable excluding patterns in run bundle uploaded output (#2344)
  • Print group permissions only if there is group permissions (#2320)

Frontend

  • Use npm ci (#2193)
  • Use percentage for worksheet-editor width (#2222)
  • Delete dialog (#2142)
  • Add button to expand/shrink worksheet width (#2130)
  • Fix additem to subworksheets_block and table_block by giving them sort keys (#2190)
  • Focus issue fixed (#2204)
  • Add padding for table standard cells (#2240)
  • Copy/Paste text to raw source with click button / keyboard (#2009)
  • Fix rerun for record-item (#2171)
  • Allow async loading of file contents (#2246)
  • Search bar for worksheets (#2181)
  • Enable bundle selection for copy on all worksheets (#2250)
  • Expand mode expands worksheet to 99% (#2270)
  • Search bar tweaks - font, usability (#2277)
  • Rename sidebar to bundleDetailSidebar (#2266)
  • Fix edit permission (#2307)
  • items=>blocks (#2308)
  • Handle item is undefined case (#2309)
  • Display tags in bundle details sidebar (#2325)
  • Worksheet tag allowed editing (#2273)
  • Cut bundle rows from worksheet (#2143)
  • Filter the ids (#2356)
  • Prioritize user's own worksheets during search (#2275)
  • Close editor before reloading after saving the text editor (#2310)
  • Disable cut button/shortcut when no edit permission (#2359)

Documentation

  • Upgrade mkdocs to 1.1 (#2281)
  • Update documentation on how to run tests (#2318)

Version 0.5.13 (April 17, 2020)

17 Apr 22:25
Compare
Choose a tag to compare

Frontend

  • Fix issues with async loading, namely: making sure search items respect schema headers (#2182), fixing a focus issue (#2182), and fixing an issue where refs are undefined (578d2ea)

Backend

  • Properly terminate a job when a job is pre-empted when running in Slurm (#2169)

Version 0.5.12 (April 16, 2020)

17 Apr 01:09
Compare
Choose a tag to compare

Frontend

  • Upload directories and multiple files from the browser, show upload progress bar, and keyboard-control upload menu (#2043)
  • Add async loading of search results in worksheets by showing a placeholder when they first load (#2086)
  • Fix mathjax loading race condition (#2131)
  • Fix vulnerabilities (#2136, #2147)
  • Fix frontend container automatically stopping in dev mode due to create-react-app upgrade (#2164)
  • Update bundle detail when detail was opened in created state (#2129)

Backend

  • Add tag_exclusive to workers that only run bundles with matching tags (#2117)
  • Prioritize bundle scheduling with request_priority (#2138)
  • Don't schedule bundles by request_queue name (#2139)
  • Add date based search to bundles (#2004)
  • set custom limits on memory through the --max-memory command line flag (#2151)

Version 0.5.11 (April 1, 2020)

02 Apr 06:33
b122395
Compare
Choose a tag to compare

Backend

  • Update pre-commit script to cleanup venv on failure and add new trouble shooting steps (#1992)
  • Update stress test script (#2076)
  • Fix build issue in Travis (#2091)
  • Improve error handling for CLI (#2049)
  • Support tagging CodaLab's public instances (#2093)
  • Bump psutil from 5.4.6 to 5.6.6 (#2087)
  • Get rid of invalid argument file when logging (#2103)
  • Check the existence of valid_bundle before further actions (#2107 )
  • Move cpu and gpu resource check to the beginning of _transition_from (#2104)
  • Adjust timezone information when calculating current container running time (#2113)
  • Binding the actual cores that can be used to the current process (#2110)
  • Make Travis badge link to build status (#2116)
  • Make cl workers show user-owned workers for non-root users (#2118)
  • Handle incompatible Cuda version specified in the user's Docker image (#2119)
  • Multi alias (#2115)
  • Redirect self.stdout when buffer doesn't exist (#2124)

Frontend

  • Worksheet title should not be editable when user doesn't have permission (#2085)
  • Use "//" comment for editor ctrl + / behavior (#2063)
  • Add queue in new run field (#2040)

Documentation

  • Improve CLI documentation and add -m option for auto generating CLI docs (#2057)
  • Readthedoc format (#2122)

Version 0.5.10 (March 16, 2020)

17 Mar 00:45
e9d62ee
Compare
Choose a tag to compare

frontend:
check subfocus index before deselecting (#2014)
collapse bundle detail after submitting rerun (#2015)
adjust maxwidths for bundle rows and detail panel for overflowing issues (#2030)
Remove uninformative NaNyNaNd in bundle view (#2037)
Click/'enter' to see record, graph mode bundle detail (#2008)
2001: Set up frontend automation using Selenium (#2028)
Improve job sorting algorithm (#2056)
Error markdowns not edittable/deletable (#2055)
deselect does not auto-scroll now (#2064)
Add Edit Worksheet Selenium test (#2084)

backend:
Allow crawling up bundle dependencies (#2000)
Add DISK_QUOTA_SLACK_BYTES when calculating the max disk quota could be requested (#2023)
Allow string and bypes when processing urllib.error.HTTPError response (#2012 )
Set user id vars of BundleModel properly (#2044)
Fix worker default cpu count to reflect SLURM limits. (#2046)
Fix bundle manager bug for bad queue argument (#2045)
Fix CPU assignment issue (#1440
Bump marshmallow to 2.15.1 (#1583)
Skip docker image size precheck if image's digest can't be found in docker hub (#2065)
Ensure data type of urllib.error.HTTPError response to be string (#2060)
2067: Skip creating a smaple worksheet if one already exists (#2068)
Add support to specify request-queue without tag= prefix (#2062)

Version 0.5.9 (February 21, 2020)

21 Feb 19:00
Compare
Choose a tag to compare

Backend

  1. reduce cache miss when deducting worker resources (#1969 )
  2. Renew WorkerInfoAccessor to avoid stale cache (#1977)
  3. bump up sqlalchemy version (#1995)
  4. make docker image size check optional (#1988)
  5. add Shm limit (#2016)
  6. Sleep less when worker-server checkin fails (#1986)
  7. resolve deadlock condition in dependency cleanup (#1985)
  8. Fix completers call (#1983)
  9. Add staged_status and filter out unqualified bundles before scheduling (#1946)
  10. Fix worker attaching issue when checking df output (#1982)
  11. increase shared memory to 500mb (#1961)
  12. Always forcibly remove docker image when pruning (#1952)
  13. handle digest spec in docker image spec (#1956)

Frontend

  1. unblock group dro paper (#2013)
  2. uncheck bundles when click on edit source' (#2003)
  3. View image detail by click and 'enter' (#1976)
  4. page title display worksheet title & table overflow with scroll (#1981)

Version 0.5.8 (February 3, 2020)

03 Feb 09:31
Compare
Choose a tag to compare

Backend:
Use docker image tags to keep track of cached images (#1927 )
Add missing parameter to get_user_parallel_run_quota_left (#1944 )
1641: Stress Test Sample Worksheets Script (#1886 )
Use docker image tags to keep track of cached images (#1927 )

Frontend:
Display a more useful failure message when a run is killed (#1938 )
fix chrome uploads by triggering uploads with a label (#1945 )

Version 0.5.7 (Jan.28.2020)

29 Jan 05:58
Compare
Choose a tag to compare

Backend

  1. Allow cl kill bundles in created, uploading, staged, making, starting and finalizing state (#1918)
  2. Reduce database calls in calculating disk quota and time quota left (#1925)
  3. Worker cleanup (#1868)
  4. No more worker lock (#1867)
  5. Cache user information when calculating parallel run quota left (#1930)
  6. Fix docker rest api v2 missing return value (#1940)