intelligent-trading-bot/docs/server.md

(OUTDATED)

Server

General system functions:

• Ping the server: https://python-binance.readthedocs.io/en/latest/general.html#id1
• Get system status: https://python-binance.readthedocs.io/en/latest/general.html#id3
• Check server time and compare with local time: https://python-binance.readthedocs.io/en/latest/general.html#id2

Time synchronization in OS and time zones

https://www.digitalocean.com/community/tutorials/how-to-set-up-time-synchronization-on-ubuntu-16-04

Check synchronization status:

$ timedatectl

"Network time on: yes" means synchronization is enabled. "NTP synchronized: yes" means time has been synchronized.

If timesyncd isn’t enabled, turn it on with timedatectl:

$ sudo timedatectl set-ntp on

Using chrony:

https://www.fosslinux.com/4059/how-to-sync-date-and-time-from-the-command-line-in-ubuntu.htm

$ sudo apt install chrony
chronyd  # One-shot time check without setting the time
chronyd -q  # One-shot sync

Create virtual environment

$ python3.7 -m pip install --user pip --upgrade
$ python3.7 -m pip install --user virtualenv --upgrade

$ python3.7 -m virtualenv --version
virtualenv 20.0.13
$ python3.7 -m virtualenv venv

Start from Linux

Modify start.py by entering data collection command. Alternatively, pass the desired command as an argument. See the file for additional comments. For example:

• collect_data is used to collect depth data by making the corresponding requests.
  • It is possible to specify frequency 1m, 5s etc.
  • It is possible to specify depth (high depth will decrease weight of the request)
• collect_data_ws is used to collect stream data like klines 1m and depth.
  • klines will get update every 1 or 2 seconds for the current 1m kline
  • Depth stream will send new depth information (limited depth) every 1 second
  • Other streams could be added to the app configuration

switch to the project root dir
$ source venv/bin/activate OR source ../trade/venv/bin/activate
(venv) $ python3.7 --version
Python 3.7.3
(venv) $ nohup python3.7 start.py &
(venv) $ nohup python3.7 start.py collect_data_ws &
<Enter>
$ logout

End:

login
ps -ef | grep python3.7
kill pid_no

Compress and download collected data files

Zip into multiple files with low priority one file:

nice -n 20 zip -s 10m -7 dest.zip source.txt

Information about zip and nice (priority):

zip -s 100m archivename.zip filename1.txt
zip -s 100m -r archivename.zip my_folder  # folder and all files recursively
nice -10 perl test.pl - run with niceness 10 (lower priority) (- is hyphen - not negative).
nice --10 perl test.pl - start with high priority (negative niceness)
nice -n -5 perl test.pl - increase priority
nice -n 5 perl test.pl - decrease priority
nice -n 10 apt-get upgrade - start with lower priority (lower values of niceness mean higher priority, so we need higher values)

Sudden reboots

Information about last reboot:

last reboot

tail /var/log/syslog or less /var/log/syslog

System wide logger:

tail /var/log/syslog
less /var/log/syslog

Kernel log:

tail /var/log/kern.log

Example automatic reboot:

last reboot
reboot   system boot  4.15.0           Thu Apr 30 08:55   still running
reboot   system boot  4.15.0           Thu Apr 30 08:21   still running

syslog
Apr 30 06:03:01 linux CRON[23790]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Apr 30 06:40:33 linux systemd[1]: Starting Daily apt upgrade and clean activities...
Apr 30 06:40:34 linux systemd[1]: Started Daily apt upgrade and clean activities.
Apr 30 06:55:06 linux systemd[1]: getty@tty2.service: Service has no hold-off time, scheduling restart.
Apr 30 06:55:06 linux systemd[1]: getty@tty2.service: Scheduled restart job, restart counter is at 876.

Check available timers, particularly, daily upgrade timer:

sudo systemctl list-timers
Fri 2020-05-01 06:14:53 UTC  19h left      Thu 2020-04-30 06:40:33 UTC  3h 58min ago apt-daily-upgrade.timer      apt

Solutions (https://superuser.com/questions/1327884/how-to-disable-daily-upgrade-and-clean-on-ubuntu-16-04):

• simply remove package unattended-upgrades: apt-get remove unattended-upgrades (but it might be insufficient)
• disable:

systemctl stop apt-daily-upgrade.timer
systemctl disable apt-daily-upgrade.timer
(systemctl disable apt-daily.service) - not clear if necessary
systemctl daemon-reload