Skip to content

2 Storage

Zack Ramjan edited this page Oct 14, 2024 · 7 revisions

Storage at VAI

How Lab storage is laid out at VAI

  • Data gets stored on our research storage sytem.
  • It is visible from all nodes.
  • Every node sees storage in the same way
  • Data Storage at VAI is organized around labs/groups, not individuals!

/home/user.name (not for data)

  • Every user has a home directory
  • Since data is organized around labs, this personal user directory is tiny and just for minor preferences and administrative files.
  • All data and tools should be in your Lab storage
  • user storage is only 20GB

/varidata/research/projects/labname

  • this is your main storage
  • for data and tools
  • But not for everything, certain documents etc should probably be stored in your oneDrive outside of HPC. ie offer letters, payroll info.
  • every lab gets 20TB and can buy more.

/varidata/researchtemp/hpctmp

  • This is an area of research storage that has no cost, but is not guaranteed to be permanant.
  • as it fills up, things may get automatically deleted.
  • no cost, great for intermediate data and processing.
  • make sure you copy anything important back to your research storage.

TASK, lets log into to Ondemand and check the storage out. https://ondemand.hpc.vai.org

Quotas (viewing your labs free space)

  • you can view your labs storage at:
  • by default only the labs that are getting full are shown on the front page.
  • but you can view your lab by name and bookmark it.
  • in the event you fill up your home dir, you will get an automated email.

Accessing data as a network drive

  • You can also connect to your lab data as a network drive.
  • smb://pn.vai.org on mac
  • \\pn.vai.org. on windows
  • This only words on official VAI equipment, best when at VAI.