Contact info

Tan | ts864@cornell.edu

Overview

Currently, the way services are deployed is basically running their Docker containers on AWS EC2 instances. Within each container, a Flask service is hosted using Gunicorn instead of native Flask to make the service more fault-tolerant.

Test and production environments for our mobile and dashboard services are deployed separately on AWS is basically having them run on an EC2 instance (with public IP 3.232.82.82). This means that each service occupies a unique port on the machine. Below is a list of running services and the ports they are using.

...

Procedure

the EC2 instances below.

Procedure

The procedure for deploying is the same for all environments. First, download the key pair file corresponding to the instance and run

chmod 400 /path/to/DIAPER-*-key.pem

Then, ssh into the corresponding First, download the key pair file DIAPER-test-key.pem and ssh into the EC2 instance using

ssh -i /path/to/DIAPER-test*-key.pem ec2-user@3.232.82.82

user@<domain>

See How to ssh into AWS / BioHPC if you're having trouble

Pull Then, pull your Docker image and other relevant file from GitHub. Instead of your own git account and password, the username is diapertestemail@gmail.com , and the password is the token in the login secrets.

Once pulled, navigate to the project folder you just uploaded folder containing docker-compose files and run the Docker as you would do locally. To keep your service from blocking the console, you should run your Docker in detached mode.

Alternatively, you can first enter ctrl-z to suspend the service and then run the following commands

bg
disown -h

Doing this also makes your service run in background.

corresponding command as explained below:

// For test environments.
./deploy.sh -n "Your Name" -m "Reason for deployment" test
 
// For production environments.
./deploy.sh -n "Your Name" -m "Reason for deployment" prod

// For local development on your laptop.
// These two commands are equivalents (i.e. default is docker-compose.yml)
sudo docker-compose -f docker-compose.yml up -d --force-recreate
sudo docker-compose up -d --force-recreate

For test and production environments, make sure to fill your name and reason for deployment. All test and production deployments will be logged in deploymentHistory.log under the same directory.

The commands above run your container in detached mode so that your service doesn't block the console. However, once a container is run in detached mode, all of its runtime errors will not be reported to the console. Thus, as the last step of deployment, you need to manually check that no runtime errors occurred during the launching of your service by looking at its log using

sudo docker-compose logs -f

If there are no runtime errors, you will get an output similar to the one below.

Image Added 

Now you can log out and the service will continue running on the EC2 instance.

Troubleshooting

Server is down

1. Reboot the instance(shown below)

Image Added

      2. If the problem persists, connect to the relevant server and run the deployment script:

// For test environments.
./deploy.sh -n "Your Name" -m "Reason for deployment" test
 
// For production environments.
./deploy.sh -n "Your Name" -m "Reason for deployment" prod

The particular issue may be highlighted during the execution of the above command.

BioHPC database timeout (Obsolete)

If you are experiencing timeout when connecting to the BioHPC database, it' probably because the EC2 instance isn't connected to Cornell's VPN. Check whether the VPN is connected with

ps -A | grep openconnect

If the output is non-empty, then the VPN is connected. If not, you can connect to the VPN using

sudo openconnect -b cuvpn.cuvpn.cornell.edu --reconnect-timeout 600

and enter necessary information as prompted.