Telemetry data eda

[isabelizimm]

Related Issues and Dependencies

#29 #33

This introduces a breaking change

• Yes
• No

This Pull Request implements

Implements EDA for telemetry dataset. Implements:

• how to load data into notebook
• provides high level analysis
• discusses differences between BackBlaze and telemetry datasets

[review-notebook-app]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[MichaelClifford]

@isabelizimm does this PR require a rebase? It looks like it has conflicts with 4 other notebooks?

[chauhankaranraj]

@isabelizimm since we're reading the data directly from the MOC s3, we do need to add the .zip and the .csv files here? I'd suggest removing them so that there's no redundancy. wdyt?

[isabelizimm]

@isabelizimm since we're reading the data directly from the MOC s3, we do need to add the .zip and the .csv files here? I'd suggest removing them so that there's no redundancy. wdyt?

I can remove those! They will be created locally whenever the wget and ZipFile commands are run, but no need to have on GitHub. However, we do have a directory ./data/ to have the csvs at hand. Do we remove that as well?

[chauhankaranraj]

I can remove those! They will be created locally whenever the wget and ZipFile commands are run, but no need to have on GitHub.

Sounds good, thanks!

However, we do have a directory ./data/ to have the csvs at hand. Do we remove that as well?

Good question, I think ideally we should add the following directories with a .gitkeep in them, to make this repo more consistent with the project-template.

.
└── data
    ├── external
    │   └── .gitkeep
    ├── interim
    │   └── .gitkeep
    ├── processed
    │   └── .gitkeep
    └── raw
        └── .gitkeep

But I don't wanna block this PR, so maybe for now we can just remove the ./data dir from this PR, and update the data directories structure in a separate PR? wdyt?

[isabelizimm]

@chauhankaranraj Agreed-- and was already on removing that directory. :) I like the idea of a .gitkeep, lets add that in a different issue.

[chauhankaranraj]

@chauhankaranraj Agreed-- and was already on removing that directory. :) I like the idea of a .gitkeep, lets add that in a different issue.

Created #40 to address this

[isabelizimm]

/retest

[chauhankaranraj]

@isabelizimm does this PR require a rebase? It looks like it has conflicts with 4 other notebooks?

@MichaelClifford I believe this PR is ready for review now :)

[MichaelClifford]

/approve

[sesheta]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: MichaelClifford

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [MichaelClifford]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment