Search for a command to run...
Platform/DevOps engineer in Dublin bringing production-grade DevOps to homelabs and small teams. I write reproducible guides with Terraform, Ansible, Proxmox, CI/CD and security hardening—always with code, diagrams, and benchmarks. Currently publishing at HomelabForge and open to impactful platform work.
No comments yet. Be the first to comment.
From manual config to idempotent IaC — covering RHEL/Rocky/Alma and Debian/Ubuntu
A DevOps engineer’s journey through Cloudflare chaos — and the free Terraform solution you can clone today.
Production DevOps for Homelabs
For accomplish this issue I required:
Steps Implement RDS,VPC,EC2,REDIS using Terraform:
See code here
Log by ssh Inside the public ec2:
ssh ec2-user@xxx.xxx.xxx.xxx -i key
Ensure that everything from the user-data.bash it's installed and start the configuration around the:
Note: there's no problem in show full code as it's a Cloud Playground and will be deleted by when it's published.
[postgresql]
host=terraform-20210731120731938300000001.cyb7h7wacdzq.us-east-1.rds.amazonaws.com
database=postgres
user=postgres
password=postgres
[redis]
redis_url=redis://redis-cache.x2mygh.0001.use1.cache.amazonaws.com:6379
# /usr/bin/python2.7
import psycopg2
from configparser import ConfigParser
from flask import Flask, request, render_template, g, abort
import time
import redis
def config(filename='config/database.ini', section='postgresql'):
# create a parser
parser = ConfigParser()
# read config file
parser.read(filename)
# get section, default to postgresql
db = {}
if parser.has_section(section):
params = parser.items(section)
for param in params:
db[param[0]] = param[1]
else:
raise Exception('Section {0} not found in the {1} file'.format(section, filename))
return db
def fetch(sql):
# connect to database listed in database.ini
ttl = 10 # Time to live in seconds
try:
params = config(filename='config/database.ini',section='redis')
cache = redis.Redis.from_url(params['redis_url'])
result = cache.get(sql)
if result:
return result
else:
# connect to database listed in database.ini
conn = connect()
cur = conn.cursor()
cur.execute(sql)
# fetch one row
result = cur.fetchone()
print('Closing connection to database...')
cur.close()
conn.close()
# cache result
cache.setex(sql, ttl, ''.join(result))
return result
except (Exception, psycopg2.DatabaseError) as error:
print(error)
def connect():
""" Connect to the PostgreSQL database server and return a cursor """
conn = None
try:
# read connection parameters
params = config()
# connect to the PostgreSQL server
print('Connecting to the PostgreSQL database...')
conn = psycopg2.connect(**params)
except (Exception, psycopg2.DatabaseError) as error:
print("Error:", error)
conn = None
else:
# return a conn
return conn
app = Flask(__name__)
@app.before_request
def before_request():
g.request_start_time = time.time()
g.request_time = lambda: "%.5fs" % (time.time() - g.request_start_time)
@app.route("/")
def index():
sql = 'SELECT slow_version();'
db_result = fetch(sql)
if(db_result):
db_version = "".join([str(i) for i in db_result])
else:
abort(500)
params = config()
return render_template('index.html', db_version = db_version, db_host = params['host'])
if __name__ == "__main__": # on running python app.py
app.run() # run the flask app
Here's the first attempt using the slow code given to the postgresql:
Second time:
Third time:
This is using Redis Cache:
Example of using the Application with connection to DB and from Redis:
(venv) [ec2-user@ip-10-0-3-203 bin]$ python app.py
* Serving Flask app 'app' (lazy loading)
* Environment: production
WARNING: This is a development server. Do not use it in a production deployment.
Use a production WSGI server instead.
* Debug mode: off
* Running on http://127.0.0.1:5000/ (Press CTRL+C to quit)
Connecting to the PostgreSQL database...
Closing connection to database...
127.0.0.1 - - [31/Jul/2021 14:56:26] "GET / HTTP/1.0" 200 -
Connecting to the PostgreSQL database...
Closing connection to database...
127.0.0.1 - - [31/Jul/2021 14:56:43] "GET / HTTP/1.0" 200 -
Connecting to the PostgreSQL database...
Closing connection to database...
127.0.0.1 - - [31/Jul/2021 14:56:58] "GET / HTTP/1.0" 200 -
127.0.0.1 - - [31/Jul/2021 14:57:01] "GET / HTTP/1.0" 200 -