airlift / slice Goto Github PK

View Code? Open in Web Editor NEW

500.0 500.0 129.0 546 KB

Java library for efficiently working with heap and off-heap memory

License: Apache License 2.0

Java 100.00%

slice's Introduction

Airlift

Airlift is a framework for building REST services in Java.

This project is used as the foundation for distributed systems like Trino (formerly PrestoSQL).

Airlift pulls together stable, mature libraries from the Java ecosystem into a simple, light-weight package that lets you focus on getting things done and includes built-in support for configuration, metrics, logging, dependency injection, and much more, enabling you and your team to ship a production-quality web service in the shortest time possible.

Airlift takes the best-of-breed libraries from the Java ecosystem and glues them together based on years of experience in building high performance Java services without getting in your way and without forcing you into a large, proprietary framework.

Getting Started

Overview
Getting Started
- Then see Next Steps

Reference

Configuration
Lifecycle/Bootstrapping
TBD - Concurrency
TBD - Database Pooling
TBD - Discovery
TBD - Events
TBD - HTTP server
HTTP client
TBD - Packaging
TBD - Logging
TBD - Tracing
TBD - Maven BOM
TBD - Jackson/JSON

Recipes

How do I ... do conditional binding based on config
How do I ... serve static HTML files
How do I ... package my service
TBD - How do I do ... ?

slice's People

Stargazers

Watchers

Forkers

randgalt chun atbrox martint dain electrum nileema stevenschlansker jsalim chuaaron rikima mkjellman seadragonnj xerial animeshinvinci sjtufighter liaochy seanjensengrey erichwang chmsword codeaudit jacobgao haozhun chakra-coder fengshao0907 drudenko andmer tempbottle karthikmit wanghuatao slamke geraint0923 tamimsyed700 baeeq amccurry hongjinwei chinpeng raghavsethi mylinyuzhi nezihyigitbasi iuliandumitru leesong-stack flakytestdetection haiderny highker leusonmario edwardbetts zhaodonghui3939 ckaudet leoyy unikrau zjpjohn pombredanne zhaoshiling1017 t-m-l-c sosojustdo archer-christ smileclound sososo425 sdtm1016 strivestruggleyou findepi sevenfang achal126 arhimondr elonazoulay yew1eb gavinljj flyyee0721 jicius mbasmanova tool-recommender-bot swainl liukun4515 analytic-hub andrewjtaylor codope yui-knk pettyjamesm kioco dasbrain prestodb kutayzorlu junhero lmf07120057 jagill javalibrary kztakuro gremlin-on-storage xiejiajun rash67 sharukhhasan wysstartgo lyzgithub finch0001 dyet92k songfj ezeeyahoo xiaojiahuo isabella232

slice's Issues

Documentation?

Is there a place where I can view documentation for this library? I see it used extensively in Presto, but I wouldn't know where to start if I wanted to use it in my own library. Is there a place we can see Slice's design and related software?

Missing negative array size check in `Slice#allocate`

This is a public method. Experience would be better if negative array size produced a user-friendly message, similar to the one we get for too large size.

https://github.com/airlift/slice/blob/master/src/main/java/io/airlift/slice/Slices.java#L83:L92

On negative size, throws

java.lang.NegativeArraySizeException: -2147483636
	at io.airlift.slice.Slices.allocate(Slices.java:91)
	at io.trino.execution.buffer.PageSerializer$WriteBuffer.<init>(PageSerializer.java:626)
	at io.trino.execution.buffer.PageSerializer$SerializedPageOutput.startPage(PageSerializer.java:154)
	at io.trino.execution.buffer.PageSerializer.serialize(PageSerializer.java:83)
	at io.trino.spiller.FileSingleStreamSpiller.writePages(FileSingleStreamSpiller.java:157)
	at io.trino.spiller.FileSingleStreamSpiller.lambda$spill$0(FileSingleStreamSpiller.java:123)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
	at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:131)
	at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:76)
	at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:82)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
	at java.base/java.lang.Thread.run(Thread.java:1583)

Document using ByteBuffer.slice() for wrappedBuffer()

Expand javadoc to note that .slice() should be called to have Slice respect the position and limit.

sun.misc.Unsafe is no longer available in JDK11

It seems sun.misc.Unsafe is deprecated since JDK11, and a replacement looks like using VarHandle:
http://openjdk.java.net/jeps/193

Do you have any idea on how we should migrate to JDK11?

remove usage of openjdk

are there any plans on removing it?
it's a gpl so it's causing all sorts of problems...

is there comparisiong for slice vs netty ByteBuf vs nio ByteBuffer ?

is there comparision for slice vs netty ByteBuf ?

Add FNV hash functions

This is in pursuance of supporting FNV hash in Presto.

jol-core is GPL

Slice is ASLv2 licensed, but has jol-core as a hard dependency. jol-core is released under the GPL.

Do you have a plan to remove the dependence on jol-core? Is there some workaround to make airlift's zstd compressor work without the GPL code?

Explicitly typed Slice

I consider using your library for API.
Unfortunately, Slice can't be explicitly typed.
If I write public Slice getValue(), user can't be sure whether it is a slice of bytes, ints or something else.
The same for parameters.
This information could be specified in doc. But we still lose type checking from the compiler.

Did you consider having several classes, for each primitive type?

I saw this comment, but, maybe, to avoid code duplication, you could have one template and a generator?