Powerupcloud's public repository
powerupcloud / awsinventorylambda Goto Github PK
View Code? Open in Web Editor NEWSave AWS inventory as CSV on S3 and trigger emails
awsinventorylambda's Introduction
awsinventorylambda's People
Contributors
Stargazers
Watchers
Forkers
manojpuc bakrudeen827 prashyt markcheshire dyale gordonmurray astro44 siva7891 breasor mariquit syst0m npettice vadirajks rajmannartech veenadev jrudge-kcom agiza siulcode eugenestarchenko somu4git nestoru coffeecoco nano803 mr-brody univrs mcenirm-forks mshannahnv danishkhakwani yusdyr raztasc jeremymturner vaibhav-walke duonghanu alexg84 vivek-siva danzelziggy rammurti84 tudoricc nitinitleen1 gjehanin wucooper fddqfddq mikecairns1 acumenix vsrathod10 coffeecocoo hemanth4984 shivrajbisht joelradon greggooden jillukowicz eduardoaw deldennis lakhan5800 rahul-bharathi manderson09 sagarragas07 bvrkorrapatiawsinventorylambda's Issues
Error while executing the script
I got error while executing the script through Lambda. The stackTrace report is as follows,
{
"stackTrace": [
[
"/var/task/lambda_function.py",
55,
"lambda_handler",
"csv_file.write(\"%s,%s\\n\"%('IAM',regname))"
]
],
"errorType": "UnboundLocalError",
"errorMessage": "local variable 'regname' referenced before assignment"
}
I used the exact same code from the latest commit but hard coded all the environment variables. The exact code which i tried to run in Lambda is,
import boto3
import collections
from datetime import datetime
from datetime import timedelta
import csv
from time import gmtime, strftime
import smtplib
from email.MIMEMultipart import MIMEMultipart
from email.MIMEBase import MIMEBase
from email.MIMEText import MIMEText
from email import Encoders
import os
#Find current owner ID
sts = boto3.client('sts')
identity = sts.get_caller_identity()
ownerId = identity['Account']
#Environment Variables
LIST_SNAPSHOTS_WITHIN_THE_LAST_N_DAYS=1
SES_SMTP_USER="XXXXXXXXXXXXXXXXX"
SES_SMTP_PASSWORD="XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
S3_INVENTORY_BUCKET="my-bucket-name"
MAIL_FROM="my-mail-id"
MAIL_TO="another-mail-id"
#Constants
MAIL_SUBJECT="AWS Inventory for " + ownerId
MAIL_BODY=MAIL_SUBJECT + '\n'
#EC2 connection beginning
ec = boto3.client('ec2')
#S3 connection beginning
s3 = boto3.resource('s3')
#lambda function beginning
def lambda_handler(event, context):
#get to the curren date
date_fmt = strftime("%Y_%m_%d", gmtime())
#Give your file path
filepath ='/tmp/AWS_Resources_' + date_fmt + '.csv'
#Give your filename
filename ='AWS_Resources_' + date_fmt + '.csv'
csv_file = open(filepath,'w+')
#IAM connection beginning - THIS Step should run only once not for every region:https://aws.amazon.com/iam/faqs/
iam = boto3.client('iam')
#No region is needed since running it from lambda fixes it
#boto3 library IAM API
#http://boto3.readthedocs.io/en/latest/reference/services/iam.html
csv_file.write("%s,%s,%s,%s\n" % ('','','',''))
csv_file.write("%s,%s\n"%('IAM',regname))
csv_file.write("%s,%s\n" % ('User','Policies'))
csv_file.flush()
users = iam.list_users()['Users']
for user in users:
user_name = user['UserName']
policies = ''
user_policies = iam.list_user_policies(UserName=user_name)["PolicyNames"]
for user_policy in user_policies:
if(len(policies) > 0):
policies += ";"
policies += user_policy
attached_user_policies = iam.list_attached_user_policies(UserName=user_name)["AttachedPolicies"]
for attached_user_policy in attached_user_policies:
if(len(policies) > 0):
policies += ";"
policies += attached_user_policy['PolicyName']
#In case you need to write this at the end of the CSV make sure to move the 2 lines from below before mail function
csv_file.write("%s,%s\n" % (user_name, policies))
csv_file.flush()
#boto3 library ec2 API describe region page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_regions
regions = ec.describe_regions().get('Regions',[] )
for region in regions:
reg=region['RegionName']
regname='REGION :' + reg
#EC2 connection beginning
ec2con = boto3.client('ec2',region_name=reg)
#boto3 library ec2 API describe instance page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_instances
reservations = ec2con.describe_instances().get(
'Reservations',[]
)
instances = sum(
[
[i for i in r['Instances']]
for r in reservations
], [])
instanceslist = len(instances)
if instanceslist > 0:
csv_file.write("%s,%s,%s,%s,%s,%s\n"%('','','','','',''))
csv_file.write("%s,%s\n"%('EC2 INSTANCE',regname))
csv_file.write("%s,%s,%s,%s,%s,%s,%s\n"%('InstanceID','Instance_State','InstanceName','Instance_Type','LaunchTime','Instance_Placement', 'SecurityGroupsStr'))
csv_file.flush()
for instance in instances:
state=instance['State']['Name']
Instancename = 'N/A'
if 'Tags' in instance:
for tags in instance['Tags']:
key = tags['Key']
if key == 'Name' :
Instancename=tags['Value']
if state =='running':
instanceid=instance['InstanceId']
instancetype=instance['InstanceType']
launchtime =instance['LaunchTime']
Placement=instance['Placement']['AvailabilityZone']
securityGroups = instance['SecurityGroups']
securityGroupsStr = ''
for idx, securityGroup in enumerate(securityGroups):
if idx > 0:
securityGroupsStr += '; '
securityGroupsStr += securityGroup['GroupName']
csv_file.write("%s,%s,%s,%s,%s,%s,%s\n"% (instanceid,state,Instancename,instancetype,launchtime,Placement,securityGroupsStr))
csv_file.flush()
for instance in instances:
state=instance['State']['Name']
Instancename = 'N/A'
if 'Tags' in instance:
for tags in instance['Tags']:
key = tags['Key']
if key == 'Name' :
Instancename=tags['Value']
if state =='stopped':
instanceid=instance['InstanceId']
instancetype=instance['InstanceType']
launchtime =instance['LaunchTime']
Placement=instance['Placement']['AvailabilityZone']
csv_file.write("%s,%s,%s,%s,%s,%s\n"%(instanceid,state,Instancename,instancetype,launchtime,Placement))
csv_file.flush()
#boto3 library ec2 API describe volumes page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_volumes
ec2volumes = ec2con.describe_volumes().get('Volumes',[])
volumes = sum(
[
[i for i in r['Attachments']]
for r in ec2volumes
], [])
volumeslist = len(volumes)
if volumeslist > 0:
csv_file.write("%s,%s,%s,%s\n"%('','','',''))
csv_file.write("%s,%s\n"%('EBS Volume',regname))
csv_file.write("%s,%s,%s,%s\n"%('VolumeId','InstanceId','AttachTime','State'))
csv_file.flush()
for volume in volumes:
VolumeId=volume['VolumeId']
InstanceId=volume['InstanceId']
State=volume['State']
AttachTime=volume['AttachTime']
csv_file.write("%s,%s,%s,%s\n" % (VolumeId,InstanceId,AttachTime,State))
csv_file.flush()
#boto3 library ec2 API describe snapshots page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_snapshots
ec2snapshot = ec2con.describe_snapshots(OwnerIds=[
ownerId,
],).get('Snapshots',[])
snapshots_counter = 0
for snapshot in ec2snapshot:
snapshot_id = snapshot['SnapshotId']
snapshot_state = snapshot['State']
tz_info = snapshot['StartTime'].tzinfo
# Snapshots that were not taken within the last configured days do not qualify for auditing
timedelta_days=-int(LIST_SNAPSHOTS_WITHIN_THE_LAST_N_DAYS)
if snapshot['StartTime'] > datetime.now(tz_info) + timedelta(days=timedelta_days):
if snapshots_counter == 0:
csv_file.write("%s,%s,%s,%s,%s\n" % ('','','','',''))
csv_file.write("%s,%s\n"%('EC2 SNAPSHOT',regname))
csv_file.write("%s,%s,%s,%s,%s\n" % ('SnapshotId','VolumeId','StartTime','VolumeSize','Description'))
csv_file.flush()
snapshots_counter += 1
SnapshotId=snapshot['SnapshotId']
VolumeId=snapshot['VolumeId']
StartTime=snapshot['StartTime']
VolumeSize=snapshot['VolumeSize']
Description=snapshot['Description']
csv_file.write("%s,%s,%s,%s,%s\n" % (SnapshotId,VolumeId,StartTime,VolumeSize,Description))
csv_file.flush()
#boto3 library ec2 API describe addresses page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_addresses
addresses = ec2con.describe_addresses().get('Addresses',[] )
addresseslist = len(addresses)
if addresseslist > 0:
csv_file.write("%s,%s,%s,%s,%s\n"%('','','','',''))
csv_file.write("%s,%s\n"%('EIPS INSTANCE',regname))
csv_file.write("%s,%s,%s,%s\n"%('PublicIp','AllocationId','Domain','InstanceId'))
csv_file.flush()
for address in addresses:
PublicIp=address['PublicIp']
try:
AllocationId=address['AllocationId']
except:
AllocationId="empty"
Domain=address['Domain']
if 'InstanceId' in address:
instanceId=address['InstanceId']
else:
instanceId='empty'
csv_file.write("%s,%s,%s,%s\n"%(PublicIp,AllocationId,Domain,instanceId))
csv_file.flush()
def printSecGroup(groupType, permission):
ipProtocol = permission['IpProtocol']
try:
fromPort = permission['FromPort']
except KeyError:
fromPort = None
try:
toPort = permission['ToPort']
except KeyError:
toPort = None
try:
ipRanges = permission['IpRanges']
except KeyError:
ipRanges = []
ipRangesStr = ''
for idx, ipRange in enumerate(ipRanges):
if idx > 0:
ipRangesStr += '; '
ipRangesStr += ipRange['CidrIp']
csv_file.write("%s,%s,%s,%s,%s,%s\n"%(groupName,groupType,ipProtocol,fromPort,toPort,ipRangesStr))
csv_file.flush()
#boto3 library ec2 API describe security groups page
#http://boto3.readthedocs.io/en/latest/reference/services/ec2.html#EC2.Client.describe_security_groups
securityGroups = ec2con.describe_security_groups(
Filters = [
{
'Name': 'owner-id',
'Values': [
ownerId,
]
}
]
).get('SecurityGroups')
if len(securityGroups) > 0:
csv_file.write("%s,%s,%s,%s,%s\n"%('','','','',''))
csv_file.write("%s,%s\n"%('SEC GROUPS',regname))
csv_file.write("%s,%s,%s,%s,%s,%s\n"%('GroupName','GroupType','IpProtocol','FromPort','ToPort','IpRangesStr'))
csv_file.flush()
for securityGroup in securityGroups:
groupName = securityGroup['GroupName']
ipPermissions = securityGroup['IpPermissions']
for ipPermission in ipPermissions:
groupType = 'ingress'
printSecGroup (groupType, ipPermission)
ipPermissionsEgress = securityGroup['IpPermissionsEgress']
for ipPermissionEgress in ipPermissionsEgress:
groupType = 'egress'
printSecGroup (groupType, ipPermissionEgress)
#RDS Connection beginning
rdscon = boto3.client('rds',region_name=reg)
#boto3 library RDS API describe db instances page
#http://boto3.readthedocs.org/en/latest/reference/services/rds.html#RDS.Client.describe_db_instances
rdb = rdscon.describe_db_instances().get(
'DBInstances',[]
)
rdblist = len(rdb)
if rdblist > 0:
csv_file.write("%s,%s,%s,%s\n" %('','','',''))
csv_file.write("%s,%s\n"%('RDS INSTANCE',regname))
csv_file.write("%s,%s,%s,%s\n" %('DBInstanceIdentifier','DBInstanceStatus','DBName','DBInstanceClass'))
csv_file.flush()
for dbinstance in rdb:
DBInstanceIdentifier = dbinstance['DBInstanceIdentifier']
DBInstanceClass = dbinstance['DBInstanceClass']
DBInstanceStatus = dbinstance['DBInstanceStatus']
try:
DBName = dbinstance['DBName']
except:
DBName = "empty"
csv_file.write("%s,%s,%s,%s\n" %(DBInstanceIdentifier,DBInstanceStatus,DBName,DBInstanceClass))
csv_file.flush()
#ELB connection beginning
elbcon = boto3.client('elb',region_name=reg)
#boto3 library ELB API describe db instances page
#http://boto3.readthedocs.org/en/latest/reference/services/elb.html#ElasticLoadBalancing.Client.describe_load_balancers
loadbalancer = elbcon.describe_load_balancers().get('LoadBalancerDescriptions',[])
loadbalancerlist = len(loadbalancer)
if loadbalancerlist > 0:
csv_file.write("%s,%s,%s,%s\n" % ('','','',''))
csv_file.write("%s,%s\n"%('ELB INSTANCE',regname))
csv_file.write("%s,%s,%s,%s\n" % ('LoadBalancerName','DNSName','CanonicalHostedZoneName','CanonicalHostedZoneNameID'))
csv_file.flush()
for load in loadbalancer:
LoadBalancerName=load['LoadBalancerName']
DNSName=load['DNSName']
CanonicalHostedZoneName=load['CanonicalHostedZoneName']
CanonicalHostedZoneNameID=load['CanonicalHostedZoneNameID']
csv_file.write("%s,%s,%s,%s\n" % (LoadBalancerName,DNSName,CanonicalHostedZoneName,CanonicalHostedZoneNameID))
csv_file.flush()
def mail(fromadd,to, subject, text, attach):
msg = MIMEMultipart()
msg['From'] = fromadd
msg['To'] = to
msg['Subject'] = subject
msg.attach(MIMEText(text))
part = MIMEBase('application', 'octet-stream')
part.set_payload(open(attach, 'rb').read())
Encoders.encode_base64(part)
part.add_header('Content-Disposition','attachment; filename="%s"' % os.path.basename(attach))
msg.attach(part)
mailServer = smtplib.SMTP("email-smtp.us-east-1.amazonaws.com", 587)
mailServer.ehlo()
mailServer.starttls()
mailServer.ehlo()
mailServer.login(SES_SMTP_USER, SES_SMTP_PASSWORD)
mailServer.sendmail(fromadd, to, msg.as_string())
# Should be mailServer.quit(), but that crashes...
mailServer.close()
date_fmt = strftime("%Y_%m_%d", gmtime())
#Give your file path
filepath ='/tmp/AWS_Resources_' + date_fmt + '.csv'
#Save Inventory
s3.Object(S3_INVENTORY_BUCKET, filename).put(Body=open(filepath, 'rb'))
#Send Inventory
mail(MAIL_FROM, MAIL_TO, MAIL_SUBJECT, MAIL_BODY, filepath)Making it play nice with lambda
I admit I don't know much regarding python but the link to make this work with lambda is 404.
I've created an IAM role and the s3 bucket but how do I edit this script to get basic functionality with my AWS account / s3 bucket and IAM role ?
I've filled in the environment variables and ensured the info is correct.
I get
Response:
{
"stackTrace": [
[
"/var/task/lambda_function.py",
276,
"lambda_handler",
"CanonicalHostedZoneName=load['CanonicalHostedZoneName']"
]
],
"errorType": "KeyError",
"errorMessage": "'CanonicalHostedZoneName'"
}
Request ID:
"d78c088c-758c-11e8-b606-251e75d4d073"
Function Logs:
START RequestId: d78c088c-758c-11e8-b606-251e75d4d073 Version: $LATEST
'CanonicalHostedZoneName': KeyError
Traceback (most recent call last):
File "/var/task/lambda_function.py", line 276, in lambda_handler
CanonicalHostedZoneName=load['CanonicalHostedZoneName']
KeyError: 'CanonicalHostedZoneName'
getting error while executing the script
below is the code i modified:
import boto3
import collections
import datetime
import csv
from time import gmtime, strftime
import smtplib
from email.MIMEMultipart import MIMEMultipart
from email.MIMEBase import MIMEBase
from email.MIMEText import MIMEText
from email import Encoders
import os
EC2 connection beginning
ec = boto3.client('ec2')
S3 connection beginning
s3 = boto3.resource('s3')
lambda function beginning
def lambda_handler(event, context):
#get to the curren date
date_fmt = strftime("%Y_%m_%d", gmtime())
#Give your file path
filepath ='/tmp/PUC_AWS_Resources_' + date_fmt + '.csv'
#Give your filename
filename ='PUC_AWS_Resources_' + date_fmt + '.csv'
csv_file = open(filepath,'w+')
#boto3 library ec2 API describe region page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_regions
regions = ec.describe_regions().get('Regions',[] )
for region in regions:
reg=region['RegionName']
regname='REGION :' + reg
#EC2 connection beginning
ec2con = boto3.client('ec2',region_name=reg)
#boto3 library ec2 API describe instance page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_instances
reservations = ec2con.describe_instances().get(
'Reservations',[]
)
instances = sum(
[
[i for i in r['Instances']]
for r in reservations
], [])
instanceslist = len(instances)
if instanceslist > 0:
csv_file.write("%s,%s,%s,%s,%s,%s\n"%('','','','','',''))
csv_file.write("%s,%s\n"%('EC2 INSTANCE',regname))
csv_file.write("%s,%s,%s,%s,%s,%s\n"%('InstanceID','Instance_State','InstanceName','Instance_Type','LaunchTime','Instance_Placement'))
csv_file.flush()
for instance in instances:
state=instance['State']['Name']
if state =='running':
for tags in instance['Tags']:
Instancename= tags['Value']
key= tags['Key']
if key == 'Name' :
instanceid=instance['InstanceId']
instancetype=instance['InstanceType']
launchtime =instance['LaunchTime']
Placement=instance['Placement']['AvailabilityZone']
csv_file.write("%s,%s,%s,%s,%s,%s\n"% (instanceid,state,Instancename,instancetype,launchtime,Placement))
csv_file.flush()
for instance in instances:
state=instance['State']['Name']
if state =='stopped':
for tags in instance['Tags']:
Instancename= tags['Value']
key= tags['Key']
if key == 'Name' :
instanceid=instance['InstanceId']
instancetype=instance['InstanceType']
launchtime =instance['LaunchTime']
Placement=instance['Placement']['AvailabilityZone']
csv_file.write("%s,%s,%s,%s,%s,%s\n"%(instanceid,state,Instancename,instancetype,launchtime,Placement))
csv_file.flush()
#boto3 library ec2 API describe volumes page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_volumes
ec2volumes = ec2con.describe_volumes().get('Volumes',[])
volumes = sum(
[
[i for i in r['Attachments']]
for r in ec2volumes
], [])
volumeslist = len(volumes)
if volumeslist > 0:
csv_file.write("%s,%s,%s,%s\n"%('','','',''))
csv_file.write("%s,%s\n"%('EBS Volume',regname))
csv_file.write("%s,%s,%s,%s\n"%('VolumeId','InstanceId','AttachTime','State'))
csv_file.flush()
for volume in volumes:
VolumeId=volume['VolumeId']
InstanceId=volume['InstanceId']
State=volume['State']
AttachTime=volume['AttachTime']
csv_file.write("%s,%s,%s,%s\n" % (VolumeId,InstanceId,AttachTime,State))
csv_file.flush()
#Give your owner ID
account_ids='753227428434'
#boto3 library ec2 API describe snapshots page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_snapshots
ec2snapshot = ec2con.describe_snapshots(OwnerIds=[
account_ids,
],).get('Snapshots',[])
ec2snapshotlist = len(ec2snapshot)
if ec2snapshotlist > 0:
csv_file.write("%s,%s,%s,%s\n" % ('','','',''))
csv_file.write("%s,%s\n"%('EC2 SNAPSHOT',regname))
csv_file.write("%s,%s,%s,%s\n" % ('SnapshotId','VolumeId','StartTime','VolumeSize'))
csv_file.flush()
for snapshots in ec2snapshot:
SnapshotId=snapshots['SnapshotId']
VolumeId=snapshots['VolumeId']
StartTime=snapshots['StartTime']
VolumeSize=snapshots['VolumeSize']
csv_file.write("%s,%s,%s,%s\n" % (SnapshotId,VolumeId,StartTime,VolumeSize))
csv_file.flush()
#boto3 library ec2 API describe addresses page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_addresses
addresses = ec2con.describe_addresses().get('Addresses',[] )
addresseslist = len(addresses)
if addresseslist > 0:
csv_file.write("%s,%s,%s,%s,%s\n"%('','','','',''))
csv_file.write("%s,%s\n"%('EIPS INSTANCE',regname))
csv_file.write("%s,%s,%s\n"%('PublicIp','AllocationId','Domain'))
csv_file.flush()
for address in addresses:
PublicIp=address['PublicIp']
AllocationId=address['AllocationId']
Domain=address['Domain']
csv_file.write("%s,%s,%s\n"%(PublicIp,AllocationId,Domain))
csv_file.flush()
#RDS Connection beginning
rdscon = boto3.client('rds',region_name=reg)
#boto3 library RDS API describe db instances page
#http://boto3.readthedocs.org/en/latest/reference/services/rds.html#RDS.Client.describe_db_instances
rdb = rdscon.describe_db_instances().get(
'DBInstances',[]
)
rdblist = len(rdb)
if rdblist > 0:
csv_file.write("%s,%s,%s,%s\n" %('','','',''))
csv_file.write("%s,%s\n"%('RDS INSTANCE',regname))
csv_file.write("%s,%s,%s,%s\n" %('DBInstanceIdentifier','DBInstanceStatus','DBName','DBInstanceClass'))
csv_file.flush()
for dbinstance in rdb:
DBInstanceIdentifier = dbinstance['DBInstanceIdentifier']
DBInstanceClass = dbinstance['DBInstanceClass']
DBInstanceStatus = dbinstance['DBInstanceStatus']
DBName = dbinstance['DBName']
csv_file.write("%s,%s,%s,%s\n" %(DBInstanceIdentifier,DBInstanceStatus,DBName,DBInstanceClass))
csv_file.flush()
ses_user = "AKIAICP6KWEKRM7X3GTA"
ses_pwd = "Ar9WyrfiTUtG376GFndoOGSyTeNIrXm0tPpec+fHWy+J"
def mail(fromadd,to, subject, text, attach):
msg = MIMEMultipart()
msg['From'] = fromadd
msg['To'] = to
msg['Subject'] = subject
msg.attach(MIMEText(text))
part = MIMEBase('application', 'octet-stream')
part.set_payload(open(attach, 'rb').read())
Encoders.encode_base64(part)
part.add_header('Content-Disposition','attachment; filename="%s"' % os.path.basename(attach))
msg.attach(part)
mailServer = smtplib.SMTP("email-smtp.us-east-1.amazonaws.com", 587)
mailServer.ehlo()
mailServer.starttls()
mailServer.ehlo()
mailServer.login(ses_user, ses_pwd)
mailServer.sendmail(fromadd, to, msg.as_string())
# Should be mailServer.quit(), but that crashes...
mailServer.close()
date_fmt = strftime("%Y_%m_%d", gmtime())
#Give your file path
filepath ='/tmp/PUC_AWS_Resources_' + date_fmt + '.csv'
#Give your filename
mail("[email protected]","PegaCloud AWS Resources","PFA for the AWS resource of pegacloud account.",filepath)
s3.Object('pega-inventory', filename).put(Body=open(filepath, 'rb'))
and while testing this function i am getting below error:
{
"stackTrace": [
[
"/var/task/lambda_function.py",
56,
"lambda_handler",
"for tags in instance['Tags']:"
]
],
"errorType": "KeyError",
"errorMessage": "'Tags'"
}
getting error while executing the script
Response:
{
"stackTrace": [
[
"/var/task/lambda_function.py",
98,
"lambda_handler",
"VolumeSize=volume['VolumeSize']"
]
],
"errorType": "KeyError",
"errorMessage": "'VolumeSize'"
}
Request ID:
"4ccfa63c-20bb-11e8-9072-9fb1bd8aac35"
Function Logs:
START RequestId: 4ccfa63c-20bb-11e8-9072-9fb1bd8aac35 Version: $LATEST
'VolumeSize': KeyError
Traceback (most recent call last):
File "/var/task/lambda_function.py", line 98, in lambda_handler
VolumeSize=volume['VolumeSize']
KeyError: 'VolumeSize'
Im getting this stacktrace error. I added VolumeSize=volume['VolumeSize'] as i need to obtain size as well. I also need to add VPCID/Subnet etc. I would try that once stack trace issue is resolved.
Code:
`import boto3
import collections
import datetime
import csv
from time import gmtime, strftime
import smtplib
from email.MIMEMultipart import MIMEMultipart
from email.MIMEBase import MIMEBase
from email.MIMEText import MIMEText
from email import Encoders
import os
#EC2 connection beginning
ec = boto3.client('ec2')
#S3 connection beginning
s3 = boto3.resource('s3')
#lambda function beginning
def lambda_handler(event, context):
#get to the curren date
date_fmt = strftime("%Y_%m_%d", gmtime())
#Give your file path
filepath ='/tmp/GIT_AWS_Resources_' + date_fmt + '.csv'
#Give your filename
filename ='GIT_AWS_Resources_' + date_fmt + '.csv'
csv_file = open(filepath,'w+')
#boto3 library ec2 API describe region page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_regions
regions = ec.describe_regions().get('Regions',[] )
for region in regions:
reg=region['RegionName']
regname='REGION :' + reg
#EC2 connection beginning
ec2con = boto3.client('ec2',region_name=reg)
#boto3 library ec2 API describe instance page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_instances
reservations = ec2con.describe_instances().get(
'Reservations',[]
)
instances = sum(
[
[i for i in r['Instances']]
for r in reservations
], [])
instanceslist = len(instances)
if instanceslist > 0:
csv_file.write("%s,%s,%s,%s,%s,%s\n"%('','','','','',''))
csv_file.write("%s,%s\n"%('EC2 INSTANCE',regname))
csv_file.write("%s,%s,%s,%s,%s,%s\n"%('InstanceID','Instance_State','InstanceName','Instance_Type','LaunchTime','Instance_Placement'))
csv_file.flush()
for instance in instances:
state=instance['State']['Name']
if state =='running':
for tags in instance['Tags']:
Instancename= tags['Value']
key= tags['Key']
if key == 'Name' :
instanceid=instance['InstanceId']
instancetype=instance['InstanceType']
launchtime =instance['LaunchTime']
Placement=instance['Placement']['AvailabilityZone']
csv_file.write("%s,%s,%s,%s,%s,%s\n"% (instanceid,state,Instancename,instancetype,launchtime,Placement))
csv_file.flush()
for instance in instances:
state=instance['State']['Name']
if state =='stopped':
for tags in instance['Tags']:
Instancename= tags['Value']
key= tags['Key']
if key == 'Name' :
instanceid=instance['InstanceId']
instancetype=instance['InstanceType']
launchtime =instance['LaunchTime']
Placement=instance['Placement']['AvailabilityZone']
csv_file.write("%s,%s,%s,%s,%s,%s\n"%(instanceid,state,Instancename,instancetype,launchtime,Placement))
csv_file.flush()
#boto3 library ec2 API describe volumes page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_volumes
ec2volumes = ec2con.describe_volumes().get('Volumes',[])
volumes = sum(
[
[i for i in r['Attachments']]
for r in ec2volumes
], [])
volumeslist = len(volumes)
if volumeslist > 0:
csv_file.write("%s,%s,%s,%s,%s\n"%('','','','',''))
csv_file.write("%s,%s\n"%('EBS Volume',regname))
csv_file.write("%s,%s,%s,%s,%s\n"%('VolumeId','VolumeSize','InstanceId','AttachTime','State'))
csv_file.flush()
for volume in volumes:
VolumeId=volume['VolumeId']
VolumeSize=volume['VolumeSize']
InstanceId=volume['InstanceId']
State=volume['State']
AttachTime=volume['AttachTime']
csv_file.write("%s,%s,%s,%s,%s\n" % (VolumeId,VolumeSize,InstanceId,AttachTime,State))
csv_file.flush()
#Give your owner ID
account_ids='675467648326'
#boto3 library ec2 API describe snapshots page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_snapshots
ec2snapshot = ec2con.describe_snapshots(OwnerIds=[
account_ids,
],).get('Snapshots',[])
ec2snapshotlist = len(ec2snapshot)
if ec2snapshotlist > 0:
csv_file.write("%s,%s,%s,%s\n" % ('','','',''))
csv_file.write("%s,%s\n"%('EC2 SNAPSHOT',regname))
csv_file.write("%s,%s,%s,%s\n" % ('SnapshotId','VolumeId','StartTime','VolumeSize'))
csv_file.flush()
for snapshots in ec2snapshot:
SnapshotId=snapshots['SnapshotId']
VolumeId=snapshots['VolumeId']
StartTime=snapshots['StartTime']
VolumeSize=snapshots['VolumeSize']
csv_file.write("%s,%s,%s,%s\n" % (SnapshotId,VolumeId,StartTime,VolumeSize))
csv_file.flush()
#boto3 library ec2 API describe addresses page
#http://boto3.readthedocs.org/en/latest/reference/services/ec2.html#EC2.Client.describe_addresses
addresses = ec2con.describe_addresses().get('Addresses',[] )
addresseslist = len(addresses)
if addresseslist > 0:
csv_file.write("%s,%s,%s,%s,%s\n"%('','','','',''))
csv_file.write("%s,%s\n"%('EIPS INSTANCE',regname))
csv_file.write("%s,%s,%s\n"%('PublicIp','AllocationId','Domain'))
csv_file.flush()
for address in addresses:
PublicIp=address['PublicIp']
AllocationId=address['AllocationId']
Domain=address['Domain']
csv_file.write("%s,%s,%s\n"%(PublicIp,AllocationId,Domain))
csv_file.flush()
#RDS Connection beginning
rdscon = boto3.client('rds',region_name=reg)
#
##boto3 library RDS API describe db instances page
##http://boto3.readthedocs.org/en/latest/reference/services/rds.html#RDS.Client.describe_db_instances
rdb = rdscon.describe_db_instances().get(
'DBInstances',[]
)
rdblist = len(rdb)
if rdblist > 0:
csv_file.write("%s,%s,%s,%s\n" %('','','',''))
csv_file.write("%s,%s\n"%('RDS INSTANCE',regname))
csv_file.write("%s,%s,%s,%s\n" %('DBInstanceIdentifier','DBInstanceStatus','DBName','DBInstanceClass'))
csv_file.flush()
for dbinstance in rdb:
DBInstanceIdentifier = dbinstance['DBInstanceIdentifier']
DBInstanceClass = dbinstance['DBInstanceClass']
DBInstanceStatus = dbinstance['DBInstanceStatus']
DBName = dbinstance['DBName']
csv_file.write("%s,%s,%s,%s\n" %(DBInstanceIdentifier,DBInstanceStatus,DBName,DBInstanceClass))
csv_file.flush()
#ELB connection beginning
elbcon = boto3.client('elb',region_name=reg)
#boto3 library ELB API describe db instances page
#http://boto3.readthedocs.org/en/latest/reference/services/elb.html#ElasticLoadBalancing.Client.describe_load_balancers
loadbalancer = elbcon.describe_load_balancers().get('LoadBalancerDescriptions',[])
loadbalancerlist = len(loadbalancer)
if loadbalancerlist > 0:
csv_file.write("%s,%s,%s,%s\n" % ('','','',''))
csv_file.write("%s,%s\n"%('ELB INSTANCE',regname))
csv_file.write("%s,%s,%s,%s\n" % ('LoadBalancerName','DNSName','CanonicalHostedZoneName','CanonicalHostedZoneNameID'))
csv_file.flush()
for load in loadbalancer:
LoadBalancerName=load['LoadBalancerName']
DNSName=load['DNSName']
CanonicalHostedZoneName=load['CanonicalHostedZoneName']
CanonicalHostedZoneNameID=load['CanonicalHostedZoneNameID']
csv_file.write("%s,%s,%s,%s\n" % (LoadBalancerName,DNSName,CanonicalHostedZoneName,CanonicalHostedZoneNameID))
csv_file.flush()
ses_user = "XXXXXX"
ses_pwd = "xxxxxxxxxxxxxx"
def mail(fromadd,to, subject, text, attach):
msg = MIMEMultipart()
msg['From'] = fromadd
msg['To'] = to
msg['Subject'] = subject
msg.attach(MIMEText(text))
part = MIMEBase('application', 'octet-stream')
part.set_payload(open(attach, 'rb').read())
Encoders.encode_base64(part)
part.add_header('Content-Disposition','attachment; filename="%s"' % os.path.basename(attach))
msg.attach(part)
mailServer = smtplib.SMTP("email-smtp.us-east-1.amazonaws.com", 587)
mailServer.ehlo()
mailServer.starttls()
mailServer.ehlo()
mailServer.login(ses_user, ses_pwd)
mailServer.sendmail(fromadd, to, msg.as_string())
# Should be mailServer.quit(), but that crashes...
mailServer.close()
date_fmt = strftime("%Y_%m_%d", gmtime())
#Give your file path
filepath ='/tmp/GIT_AWS_Resources_' + date_fmt + '.csv'
#Give your filename
mail("[email protected]","[email protected]","github AWS Resources","PFA for the AWS resource of github account.",filepath)
s3.Object('git-aws-inventory', filename).put(Body=open(filepath, 'rb'))`
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.