kruize / kruize-demos Goto Github PK

Update Autotune demo script to demonstrate End-to-End Autotune workflow

Hi @chandrams , @bharathappali ,

Need help in setting this demo application

I have setup this demo application in my locally and seems the application came up but when I try to hit the endpoints in the logs I get page cannot be displayed .

one change I have done is changed the MIN_MEM from 16384 to 7128

I am attaching the logs below,

autotune-f44b6c8d4-65rlc 1/2 CrashLoopBackOff 2 (16s ago) 2m45s

Log.txt

when i checked the logs i am getting this error in the log

`
--/ __ / / / / _ | / _ / /// / / / /
-/ // / // / __ |/ , / ,< / // /
--// |//|//||//
2024-02-29 07:24:45,445 WARN [io.agr.pool] (agroal-11) Datasource '': The connection attempt failed.
2024-02-29 07:24:45,446 WARN [org.hib.eng.jdb.env.int.JdbcEnvironmentInitiator] (main) HHH000342: Could not obtain connection to query metadata: org.postgresql.util.PSQLException: The connection attempt failed.
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:315)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:51)
at org.postgresql.jdbc.PgConnection.(PgConnection.java:223)
at org.postgresql.Driver.makeConnection(Driver.java:465)
at org.postgresql.Driver.connect(Driver.java:264)
at io.agroal.pool.ConnectionFactory.createConnection(ConnectionFactory.java:204)
at io.agroal.pool.ConnectionPool$CreateConnectionTask.call(ConnectionPool.java:490)
at io.agroal.pool.ConnectionPool$CreateConnectionTask.call(ConnectionPool.java:472)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at io.agroal.pool.util.PriorityScheduledExecutor.beforeExecute(PriorityScheduledExecutor.java:68)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: java.net.SocketTimeoutException: Connect timed out
at java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:546)
at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:597)
at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327)
at java.base/java.net.Socket.connect(Socket.java:633)
at org.postgresql.core.PGStream.createSocket(PGStream.java:231)
at org.postgresql.core.PGStream.(PGStream.java:95)
at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:98)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:213)
... 12 more

2024-02-29 07:24:55,621 WARN [io.agr.pool] (agroal-11) Datasource '': The connection attempt failed.
2024-02-29 07:24:55,622 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (main) SQL Error: 0, SQLState: 08001
2024-02-29 07:24:55,623 ERROR [org.hib.eng.jdb.spi.SqlExceptionHelper] (main) The connection attempt failed.
2024-02-29 07:24:55,635 ERROR [io.qua.run.Application] (main) Failed to start application (with profile prod): java.net.SocketTimeoutException: Connect timed out
at java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:546)
at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:597)
at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327)
at java.base/java.net.Socket.connect(Socket.java:633)
at org.postgresql.core.PGStream.createSocket(PGStream.java:231)
at org.postgresql.core.PGStream.(PGStream.java:95)
at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:98)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:213)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:51)
at org.postgresql.jdbc.PgConnection.(PgConnection.java:223)
at org.postgresql.Driver.makeConnection(Driver.java:465)
at org.postgresql.Driver.connect(Driver.java:264)
at io.agroal.pool.ConnectionFactory.createConnection(ConnectionFactory.java:204)
at io.agroal.pool.ConnectionPool$CreateConnectionTask.call(ConnectionPool.java:490)
at io.agroal.pool.ConnectionPool$CreateConnectionTask.call(ConnectionPool.java:472)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at io.agroal.pool.util.PriorityScheduledExecutor.beforeExecute(PriorityScheduledExecutor.java:68)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)

`
Kindly help on this issue

Update autotune demo readme

• Change references of SLA to SLO
• Usage information needs to be updated

Hi @chandrams @kusumachalasani ,
I am trying to use autotune on my local machine.

while bringing up auto tune it crashes and going into loopback
getting this error

It is unable to pick the config map .Any suggestions on quick fixes for this?

Capture resource usage when HPO experiments are scaled 10x or 100x times

Update HPO demo with plot API & importance

When the folders autotune or benchmarks exist in the autotune-demo folder, mostly as a result of an earlier run, the minikube-demo-setup.sh throws up an error

#######################################
#        Autotune Demo Setup          #
#######################################


#######################################
1. Cloning autotune git repos
ERROR: git clone [email protected]:kruize/autotune.git failed.

To make it work as expected, we have to manually delete the folders using rm -rf autotune benchmarks.

Ideally, we should be either checking if the folders exist first, and then pull the changes, or just delete the folders everytime when we run the script.