a blog about using technology such as python/pandas to analyze different data to dig out stories underneath.
Sunday, 2 December 2018
Collection of data API vendors for cryptocurrency
https://www.coinapi.io/pricing
https://min-api.cryptocompare.com/pricing
https://pro.coinmarketcap.com/pricing
https://coinmetrics.io/api/
Schedule regular tasks in AWS
I spent lots of time on this tiny problem, I would like to tell you, all you see on other websites which teach you to use 'crobtab -e' or other method in Linux won't work in AWS, it looks AWS system totally ignore those settings. I don't like those guys copy from each other without actually validating it, it really waste audiences' lots of time.
The only way to schedule regular tasks in aws via cron is to make a new file without any extension under this fold:
/etc/cron.d/
This is my setting:
vi /etc/cron.d/dailyPriceUpdate
This means to use the 'root' role to:
1. go to directory /home/ubuntu/aushare, remember those environment path won't work automatically in cron;
2. execute /home/ubuntu/anaconda3/bin/python /home/ubuntu/aushare/ASXScrapShareDailyPrice.py;
3. log to /home/ubuntu/dailyPriceUpdate.log;
4. 2>&1 means log errors to the file as well.
Subscribe to:
Posts (Atom)