Cloud Setup on AWS

Hi Brian,

I'm trying to setup an AWS cloud environment. When going through the steps you have in the "Installation Tutorial for Cloud" it seems that the Docker Machine has been deprecated Docker Machine | Docker Documentation

Does that change the installation process? Also, do you have any suggestions as to the best type of AWS server for running live strategies with QuantRocket?

Thank you,
Bruno

You can still use Docker Machine. It has not been actively developed for some time but still works fine. We will update our documentation links now that Docker has removed its own documentation. In the future we will move away from Docker Machine because eventually deprecated tools tend to get old and crusty, but that does not happen for some time.

The system requirements can be used as a guide to instance type selection.

Hi Brian, something is going on during re-installation of QR on my DigitalOcean Server. I keep getting the error below when I run docker-compose -p quantrocket up -d

ERROR: for houston ('Connection aborted.', OSError(22, 'Invalid argument'))
ERROR: Couldn't connect to Docker daemon - you might need to run docker-machine start default.
Exception ignored in: <function Popen.del at 0x00000123D16F8D30>
Traceback (most recent call last):
File "subprocess.py", line 1051, in del
File "subprocess.py", line 1453, in _internal_poll
OSError: [WinError 6] The handle is invalid
Exception ignored in: <function Popen.del at 0x00000123D16F8D30>
Traceback (most recent call last):
File "subprocess.py", line 1051, in del
File "subprocess.py", line 1453, in _internal_poll
OSError: [WinError 6] The handle is invalid

I've tried restarting the cloud machine and tried re-installing according to your instructions 3 times.

Any idea why this is happening?

Thank you

Another error:

quantrocket_flightlog_1 is up-to-date
quantrocket_ibgrouter_1 is up-to-date
quantrocket_ibg1_1 is up-to-date
quantrocket_zipline_1 is up-to-date
quantrocket_moonshot_1 is up-to-date
quantrocket_codeload_1 is up-to-date
quantrocket_countdown_1 is up-to-date
quantrocket_license-service_1 is up-to-date
quantrocket_jupyter_1 is up-to-date
quantrocket_postgres_1 is up-to-date
quantrocket_theia_1 is up-to-date
quantrocket_satellite_1 is up-to-date
quantrocket_db_1 is up-to-date
quantrocket_blotter_1 is up-to-date
quantrocket_realtime_1 is up-to-date
quantrocket_account_1 is up-to-date
quantrocket_master_1 is up-to-date
quantrocket_history_1 is up-to-date
quantrocket_fundamental_1 is up-to-date
Creating quantrocket_houston_1 ... done
Creating quantrocket_logspout_1 ... done
Exception ignored in: <function Popen.del at 0x000001D81D2E8D30>
Traceback (most recent call last):
File "subprocess.py", line 1051, in del
File "subprocess.py", line 1453, in _internal_poll
OSError: [WinError 6] The handle is invalid

failed to open the raw stream connection: dial unix /var/run/docker.sock: connect: permission denied
Traceback (most recent call last):
File "urllib3\connectionpool.py", line 670, in urlopen
File "urllib3\connectionpool.py", line 426, in _make_request
File "", line 3, in raise_from
File "urllib3\connectionpool.py", line 421, in _make_request
File "http\client.py", line 1349, in getresponse
File "http\client.py", line 935, in close
File "docker\transport\sshconn.py", line 102, in close
OSError: [Errno 22] Invalid argument

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "requests\adapters.py", line 439, in send
File "urllib3\connectionpool.py", line 726, in urlopen
File "urllib3\util\retry.py", line 410, in increment
File "urllib3\packages\six.py", line 734, in reraise
File "urllib3\connectionpool.py", line 670, in urlopen
File "urllib3\connectionpool.py", line 426, in _make_request
File "", line 3, in raise_from
File "urllib3\connectionpool.py", line 421, in _make_request
File "http\client.py", line 1349, in getresponse
File "http\client.py", line 935, in close
File "docker\transport\sshconn.py", line 102, in close
urllib3.exceptions.ProtocolError: ('Connection aborted.', OSError(22, 'Invalid argument'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "docker\api\client.py", line 214, in _retrieve_server_version
File "docker\api\daemon.py", line 181, in version
File "docker\utils\decorators.py", line 46, in inner
File "docker\api\client.py", line 237, in _get
File "requests\sessions.py", line 543, in get
File "requests\sessions.py", line 530, in request
File "requests\sessions.py", line 643, in send
File "requests\adapters.py", line 498, in send
requests.exceptions.ConnectionError: ('Connection aborted.', OSError(22, 'Invalid argument'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "docker-compose", line 3, in
File "compose\cli\main.py", line 81, in main
File "compose\cli\main.py", line 200, in perform_command
File "compose\cli\command.py", line 60, in project_from_options
File "compose\cli\command.py", line 152, in get_project
File "compose\cli\docker_client.py", line 41, in get_client
File "compose\cli\docker_client.py", line 170, in docker_client
File "docker\api\client.py", line 197, in init
File "docker\api\client.py", line 221, in _retrieve_server_version
docker.errors.DockerException: Error while fetching server API version: ('Connection aborted.', OSError(22, 'Invalid argument'))
[20584] Failed to execute script docker-compose