Viewing a single comment thread. View all comments

cthorrez t1_jecv5ox wrote

Code quality of my own and my team's code

The reliability of the engineering platforms we use. (spark, gpu clusters, ci/cd build pipelines)

The correctness and completeness of the data we ingest

4

General-Wing-785 OP t1_jedkzcg wrote

Thanks! A few follow up questions:

  • do you do most of your experiments in a notebook and then manually translate it to a classic python project for code review/deployments?
  • what has been the most frustrating part about the engineering platforms? Non deterministic build/compute times?
  • do you use any data auditing libraries for data quality?
0