Giter VIP home page Giter VIP logo

Hi, I'm Dogukan Uraz

I like to research AI supercomputing kernels, hardware-aware computations, multimodal foundation models, and scaling mechanisms. I regularly share about my work, learning notes, contributions at medium.com/@simudt. All of my open-source AI projects are available at github.com/simudt?tab=repositories.

Latest Repositories (top_k=8)

Technical Blog Posts

Social

simudt @simudt

Simu's Projects

griffin-jax icon griffin-jax

Jax implementation of "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"

human-assistant icon human-assistant

Human & Assistant is a very simple library created to make transformations on conversational datasets for fine-tuning chat templates, compatibility with 🤗 Datasets.

jax-triton icon jax-triton

jax-triton contains integrations between JAX and OpenAI Triton

kmeansops icon kmeansops

PyKeops Powered K-Means Clustering Algorithms Module both on CPU & GPU

lmppl-cli-csv-wrapper icon lmppl-cli-csv-wrapper

A tiny CLI wrapper around lmppl for Pre-Trained Language Models Perplexity Calculation for CSV files

longconv-jax icon longconv-jax

Jax/Flax/Linen implementation of "Simple Hardware-Efficient Long Convolutions for Sequence Modeling"

megabyte-pytorch-ds icon megabyte-pytorch-ds

Modificated DeepSpeed training setup fork of MEGABYTE - PyTorch by lucidrains, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

minif2f-code icon minif2f-code

Dataset of formal Olympiad-level mathematics problems solved with Python code instructions.

mpi-ds icon mpi-ds

MPI Operator DeepSpeed Base Configuration for CIFAR-10

palm-rlhf-pytorch-ds icon palm-rlhf-pytorch-ds

Modificated DeepSpeed training setup fork of RLHF (Reinforcement Learning with Human Feedback) by lucidrains on top of the PaLM architecture. Basically ChatGPT but with PaLM

pytorch icon pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

ring-attention-jax icon ring-attention-jax

Packaged Ring Attention with Blockwise Transformers for Near-Infinite Context implemented in Jax + Flax.

sdcpt icon sdcpt

A tiny package provides distance computations for PyTorch functions.

simba icon simba

A simpler Pytorch + Zeta Implementation of the paper: "SiMBA: Simplified Mamba-based Architecture for Vision and Multivariate Time series"

srt-transformer icon srt-transformer

A tiny CLI tool that transforms SRTs into word-by-word timestamped SRTs.

tri-rmsnorm icon tri-rmsnorm

Efficient kernel for RMS normalization with fused operations, includes both forward and backward passes, compatibility with PyTorch.

triton-activations icon triton-activations

Collection of neural network activation function kernels for Triton Language Compiler by OpenAI

zeta icon zeta

Build high-performance AI models with modular building blocks

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.