-
Notifications
You must be signed in to change notification settings - Fork 6
/
form.yml.erb
107 lines (107 loc) · 3.05 KB
/
form.yml.erb
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
<%-
groups = OodSupport::User.new.groups.sort_by(&:id).tap { |groups|
groups.unshift(groups.delete(OodSupport::Process.group))
}.map(&:name).grep(/^P./)
-%>
---
cluster:
- "owens"
- "pitzer"
form:
- account
- jupyterlab_switch
- spark_version
- bc_num_hours
- bc_num_slots
- node_type
- num_workers
- spark_configuration_file
- only_driver_on_root
- include_tutorials
- bc_email_on_started
- version
attributes:
account:
label: "Project"
widget: select
options:
<%- groups.each do |group| %>
- "<%= group %>"
<%- end %>
num_workers:
widget: "number_field"
value: "1"
min: "1"
max: "28"
label: "Number of workers per node"
help: |
This describes how the cores and memory are divvied up on the node
(*useful to reduce memory allocated for each worker*). Should be a
multiple of the number of cores on the node you chose above. Do **NOT**
exceed the number of cores on the node.
node_type:
widget: select
label: "Node type"
help: |
- **any** - (*28 cores Owens*, *40 cores Pitzer*) Use any available Owens or Pitzer node. This reduces the
wait time as there are no node requirements.
- **hugemem** - (*4-48 cores Owens*, *20-80 cores Pitzer*) Use an Owens node that has 1.5TB of
available RAM as well as 48 cores, or a Pitzer node that has 3TB of available RAM as well as 80 cores.
There are 16 of these nodes on Owens and 4 on Pitzer.
options:
- [
"any", "any",
data-max-num-workers-for-cluster-owens: 28,
data-max-num-workers-for-cluster-pitzer: 48,
]
- [
"hugemem", "hugemem",
data-max-num-workers-for-cluster-owens: 48,
data-max-num-workers-for-cluster-pitzer: 80,
]
spark_configuration_file:
help: Override defaults with a new configuration file. Leave blank to use defaults.
only_driver_on_root:
widget: "check_box"
label: Only launch the driver on the master node.
help: |
This is typically used for `.collect` and `.take` operations that require
a large amount of memory allocated (> 2GB) for the driver process.
include_tutorials:
widget: "check_box"
label: Include access to OSC tutorial/workshop notebooks.
jupyterlab_switch:
widget: "check_box"
label: "Use JupyterLab instead of Jupyter Notebook?"
help: |
JupyterLab is the next generation of Jupyter, and is completely compatible with existing Jupyter Notebooks.
spark_version:
widget: "select"
options:
- [
"3.4.1", "3.4.1",
]
- [
"3.0.1", "3.0.1",
]
- [
"2.4.5", "2.4.5",
data-option-for-cluster-owens: false,
]
- [
"2.3.0", "2.3.0",
data-option-for-cluster-pitzer: false
]
version:
widget: "select"
label: "JupyterLab Version"
options:
- [
"3.0", "app_jupyter/3.0.17",
]
- [
"2.2", "app_jupyter/2.2.10",
]
- [
"1.2", "app_jupyter/1.2.21",
]