Comments (5)
@dmitryduev which log file would you like parsed specifically, and what should I extract from them? I see that the code here looks at alert_watcher*
logs but there are also alert_broker
logs in the Kowalski data directories as well? Do you essentially just want what's in this code snippet but run and posted regularly?
from kowalski.
ah, good point. It should be dask_cluster.log*
-- extract how long different operations take.
essentially, yes :)
from kowalski.
Okay, sounds good :) And do I want the logs from kowalski_ingester_1
or kowalski_api_1
or both? @dmitryduev
from kowalski.
they share the same /data
, so either one.
from kowalski.
Aha, you're right I'd forgotten that.
from kowalski.
Related Issues (20)
- Non-docker-based build system HOT 1
- CI action to deploy to staging on PR merges/commits to master
- add IGAPS dataset HOT 4
- Ingest VSX catalog HOT 2
- Ingestion script for public ZTF light curves HOT 2
- Add some salt to generated tokens
- Test ZTF matchfile ingestion HOT 1
- Ingestion script for ZTF light curve features HOT 1
- Alert photometry must be posted to SkyPortal per stream in alert_broker_ztf.py
- Move "Get group info" histogram to first SP ops plot
- TNS on Fritz front end reports "No matches found", but when TNS searched, object found
- Update TNS "mirror" service
- Refactor all data ingest scripts into a general class + subclassing HOT 2
- ZTFTriggerHandler should gracefully handle repeated queue name
- A file is missing HOT 3
- The Docker + TensorFlow + M1 Mac Book is incompatible. HOT 2
- How to ingest local data into kowalski HOT 19
- Assessing completeness of ingested catalogs
- iterrows in catalog ingestion casts all dtypes to float HOT 3
- Milliquas crossmatch on alert package HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kowalski.