Comments (7)
Hello,
Sorry to hear you have an issue with this. Can you please confirm that the user credentials applied to your session where you are running the setup.js has rights to the AWS Key Management Service, specifically kms:DescribeKey, kms:GetKeyPolicy and kms:Encrypt?
Thx,
Ian
from aws-lambda-redshift-loader.
I've also just pushed a small update to kmsCrypto.js that should result in a better error message than what you are getting now.
from aws-lambda-redshift-loader.
Ian, thanks for the quick response. I did a pull and re ran the setup. The new error message is below:
Unknown Error during Customer Master Key describe
Error during resolution of Customer Master Key
/Users/andrewguy/src/aws-lambda-redshift-loader/node_modules/aws-sdk/lib/request.js:32
throw err;
^
TypeError: Cannot read property 'length' of null
at Object.toLambdaStringFormat (/Users/andrewguy/src/aws-lambda-redshift-loader/kmsCrypto.js:222:14)
at /Users/andrewguy/src/aws-lambda-redshift-loader/setup.js:139:19
at /Users/andrewguy/src/aws-lambda-redshift-loader/kmsCrypto.js:105:11
at Response.<anonymous> (/Users/andrewguy/src/aws-lambda-redshift-loader/kmsCrypto.js:83:12)
at Request.<anonymous> (/Users/andrewguy/src/aws-lambda-redshift-loader/node_modules/aws-sdk/lib/request.js:350:18)
at Request.callListeners (/Users/andrewguy/src/aws-lambda-redshift-loader/node_modules/aws-sdk/lib/sequential_executor.js:100:18)
at Request.emit (/Users/andrewguy/src/aws-lambda-redshift-loader/node_modules/aws-sdk/lib/sequential_executor.js:77:10)
at Request.emit (/Users/andrewguy/src/aws-lambda-redshift-loader/node_modules/aws-sdk/lib/request.js:604:14)
at Request.transition (/Users/andrewguy/src/aws-lambda-redshift-loader/node_modules/aws-sdk/lib/request.js:21:12)
at AcceptorStateMachine.runTo (/Users/andrewguy/src/aws-lambda-redshift-loader/node_modules/aws-sdk/lib/state_machine.js:14:12)
I'm running with credentials in .aws/credentials that have this policy:
{
"Statement": [
{
"Effect": "Allow",
"NotAction": "iam:",
"Resource": ""
}
]
}
That should work, or no? Is KMS categorized under IAM?
Thanks,
Andy
from aws-lambda-redshift-loader.
So not much better of an error message then. You will need kms :* grants to use so, a well as dynamo db write privileges.
from aws-lambda-redshift-loader.
Once I ran export AWS_.... instead of relying on the credentials file, the script completed. Why would it not read my credential file? the permissions seem fine on it.
from aws-lambda-redshift-loader.
For the javascript SDK, it has to be in your home folder/.aws/credentials. Was that the path for the file?
from aws-lambda-redshift-loader.
Yes, it is definitely in there:
/Users/andrewguy/.aws/credentials
I believe this happened with another AWS service before on my system..hmmm. Anyway, I believe this issue can be closed, since the original problem has been solved.
from aws-lambda-redshift-loader.
Related Issues (20)
- Remaining duration of <negativenumber> insufficient to load cluster
- make moduleKeyName configurable in kmsCryto.js HOT 2
- Unable to validate the following destination configurations HOT 7
- node setup-file.js throw err;
- Unable to batch and COPY .parquet files via manifest file HOT 12
- batchOperations.js error HOT 7
- Add ttl to auto-expire entries in LambdaRedshiftBatches and LambdaRedshiftProcessedFiles
- What is the easiest way to delete historical LambdaRedshiftProcessedFiles HOT 1
- How do load the same file with a different timestamp? HOT 1
- Dataloss issue with this lambda redshift loader HOT 7
- Cluster Security VPC
- Option to disable hive partitioning wild cards HOT 8
- files not loaded occasionally due "another thread has locked it for loading" HOT 22
- files not loaded because they may be in 'locked' state (though they aren't) HOT 2
- ERR_TLS_CERT_ALTNAME_INVALID HOT 3
- Loader doesn't work on node 14 HOT 1
- Aborted query notification in Redshift HOT 4
- LambdaRedshiftBatches in "locked" status - solved
- Manifest missing file returned in describeBatch.js HOT 4
- Shouldn't lambda-redshift-loader be released? HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from aws-lambda-redshift-loader.