Data Collection

Creating Data Collectors

Latest Update: 03.05.2021

Choosing the right tool to collect data is a critical decision point. Caffeine Lab trusts both Python Flask and FastAPI to do the work and get the data into your workflow quickly. Use the right tools to clean and transform data and then pipe it to any number of storage engines.

Projects Related to Data Identification

US Energy Markets

Retrieve data from PJM, ERCOT and MISO

Coming soon

How to recieve data and store in an S3 bucket.