pulling data

okay so i created a really simple barebones version of my api data scraper.

so the next step after that is to set up the database and then write the script to continuously pull in the data into the database.

i basically just want a continuous snapshot of the data and then i want to see if there’s any correlation in the data.

i want to pull in all the players once a day. this data will be pulled in once a day. this data will also need to be flattened and the columns will be set.

so that took much longer than i thought but i do have at least one of the cron jobs running on the web. this is the script:

the cron job itself runs every 12 hours on render.com. that might be overkill for this specific job, i might just make it once a day. i need to repeat this for my other scripts too.

---

28 - 03/27/2025