Published onApril 8, 2025Complex SQL to Filter Through 20 Million Rows of Option Chain Snapshot Dataoptionsquestdbsqldata-analysisvol-surfacepolarsrefactoringperformanceTransforming raw data into something that's more meaningful - how I optimized the app via lazily-evaluated vectorized polars operations and by pushing the filtering up in the data pipeline
Published onFebruary 27, 2024Data Collection and Manipulation on the Command Linecommand-linetechsqldatasqliteslurmhpcfeaturedAKA "How to grab the best GPU instance in a slurm-managed HPC cluster faster than anyone else"