Comments (3)
@lostluck so far I found that job being stuck, reported by the panic, may be due to the upstream watermark. In the following logs, I see a reporting of "insufficient upstream watermark" i.e. inputW == upstreamW
in the bundleReady method. One hypothesis generating idea would be to collect which Java validates runner tests are leading to the panic to detect a potential pattern.
{"time":"2024-06-03T23:16:17.984115241Z","level":"DEBUG","msg":"bundleReady: insufficient upstream watermark","stage":"stage-001","watermark":{"upstream":9223372036854775,"input":9223372036854775}}
{"time":"2024-06-03T23:16:17.984145011Z","level":"DEBUG","msg":"Bundles: nothing in progress after advance","advanced":{"stage-001":{}},"refreshCount":1,"pendingElementCount":2}
{"time":"2024-06-03T23:16:17.984161971Z","level":"DEBUG","msg":"bundleReady: insufficient upstream watermark","stage":"stage-006","watermark":{"upstream":-9223372036854775,"input":-9223372036854775}}
{"time":"2024-06-03T23:16:17.984172671Z","level":"DEBUG","msg":"Bundles: nothing in progress and no refreshes","pendingElementCount":2}
panic: nothing in progress and no refreshes with non zero pending elements: 2
from beam.
I'd put the test (and clarify that it's running on prism) in the title instead of the symptom. The panic is to avoid a forever hang when there is no way to make progress. It's never going to be unique to this test. You will see this much more.
from beam.
I'd put the test (and clarify that it's running on prism) in the title instead of the symptom. The panic is to avoid a forever hang when there is no way to make progress. It's never going to be unique to this test. You will see this much more.
Multiple tests result in this panic. I just chose one so it is quick to get to this state.
from beam.
Related Issues (20)
- The Cancel Stale Dataflow Jobs job is flaky
- [Bug]: WriteToFiles using a custom sink with compression type .bz2 flush errors.
- [Feature Request]: Tour of Beam should use the beam.LogElements transform instead of defining `class Output(beam.PTransform):`
- [CsvIO]: Create scaffold CsvIOParseKV class
- [Task]: Break up single pending stream commit into multiple commits HOT 1
- [CsvIO]: Implement CsvIOParseKV::expand() and finalize CsvIOParseKV class
- [CsvIO]: Create CsvIOParse scaffold
- [CsvIO]: Implement CsvIOParse::withCustomrecordParsing method
- [CsvIO]: Implement CsvIOParse::parseCell method
- [CsvIO]: CsvIOParse::expand implementation and class completion
- [CsvIO]: Create CsvIOParseKV::withCustomRecordParsing
- The Build python source distribution and wheels job is flaky HOT 1
- Bug: Beam not populating "googclient_deliveryattempt" attribute in attributes map HOT 1
- [CsvIO]: Create CsvIOFileBasedSource class
- [Task]: fix a potential bug in TimeRangeTracker HOT 1
- [Task]: Upgrade gcs-connector libraries to 3.x HOT 1
- [Feature Request]: Support streaming inserts for bounded PCollections
- The PostCommit Java Examples Dataflow ARM job is flaky HOT 1
- [Feature Request]: Support writing to a Solace message broker
- The Java Tests job is flaky
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from beam.