Comments (4)
antmoth
commented on August 30, 2024
The current blocker is that when the staging server is up and running, livy doesn't respond to any attempts at contact. Working on this with ops.
from combine.
antmoth
commented on August 30, 2024
Livy was having an issue with conflicting jar files for jetty. It's possible that fixing that fixes the issue. I tried to deploy to a fresh ubuntu VM from scratch and have been running into all sorts of other problems. There's a python3/python2 issue...
from combine.
antmoth
commented on August 30, 2024
Okay! I think I have a working staging deployment!
The final issue was that Livy was trying to reach Spark on an address that was equivalent to localhost but that didn't resolve to localhost. Adding the addresses it was using to the /etc/hosts file fixed the problem.
The key error here was:
19/08/19 11:21:25 INFO utils.LineBufferedStream: 2019-08-19 11:21:25 WARN RSCConf:146 - Your hostname, [redacted], resolves to a loopback address, but we couldn't find any external IP address!
from combine.
ghukill
commented on August 30, 2024
Ah-ha! Good find.
from combine.
Related Issues (20)
- Investigate migrating to PostgreSQL HOT 1
- Clarify wording on configuration 'payloads'
- Add data migration to seed standard local xslt includes
- Update to Django 2.2
- have discussion about tabular / spreadsheet harvesting
- Implement clever workaround for accessing livy and spark sessions w/o opening ports HOT 1
- Local-ified HTTP includes should add the name of the include?
- Wrap user-provided python code in RestrictedPython HOT 1
- use refactored OAI engine from Ingestion3
- Release 0.11, docker-ized HOT 2
- Add a more accurate message to the "Is Valid" field when a job did not include validation HOT 1
- Disable user-submitted python code by default HOT 3
- Add 'Last Modified' column to Organization Record Groups page HOT 1
- Gracefully import TransformationScenarios and TransformJobs HOT 1
- Some combine administrative pages don't forward anonymous users to the login page.
- XML errors not accurately transmitted
- Stop having foreign key references to User on exportable objects
- Display of /combine/organization/SomeOrgNum fails when Record Groups have no corresponding Jobs
- Combine Playbook URL does not work
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from combine.