Comments (1)
lgr
commented on August 21, 2024
5
I have exactly the same issue. Locally the library works well (tested in docker i386/ubuntu:latest). It seems that Redshift doesn't allow loading C libraries from the Python code - or to be more precise, it doesn't allow open any non-Python files within the library. More details are described in this article:
Only one thing is missing! They don’t let you to read files either. If your Python package want to open any file then the package will fail instantly.
Failing library part is the following:
libh3 = cdll.LoadLibrary(libh3_path)
and even after changing the library path to be an absolute path:
libh3 = cdll.LoadLibrary(os.path.abspath(libh3_path))
The loading operation fails anyway. Any clues how to overcome this limitation @zach-data @IanMeyers?
from amazon-redshift-udfs.
Related Issues (20)
- RedShift function to import S3 file HOT 1
- Script fails to find wheel files or zip results. HOT 1
- import fails for murmur2 package HOT 2
- Questions from AWS customer HOT 5
- [Enhancement] f_rank_td HOT 1
- [Enhancement] f_oreplace_td
- [Enhancement] f_octet_length_td
- [Enhancement] f_char2hexint_td
- [Enhancement] f_csvld_td
- [Enhancement] f_nvp_td
- [Enhancement] f_transalate_td
- [Enhancement] f_translate_chk_td
- [Enhancement] Support Python Lambda UDFs w/ dependent libraries
- [Enhancement] Example for C++ Lambda UDF
- [Enhancement] Example Java UDF HOT 2
- [Feature Request] String comparison Python UDF example HOT 1
- Broken link to index.js for lambda-udfs/f_upper_nodejs
- Support non-Commercial partitions
- ua-parser not working: No module named _regexes. Please look at svl_udf_log for more information HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from amazon-redshift-udfs.