Giter VIP home page Giter VIP logo

tw1ddle / markov-namegen-lib Goto Github PK

View Code? Open in Web Editor NEW
22.0 3.0 2.0 447 KB

✒️ Markov process-based procedural name and word generator library

Home Page: https://samcodes.co.uk/web/

License: MIT License

Haxe 72.34% Shell 0.95% JavaScript 13.13% CSS 13.32% Batchfile 0.27%
procedural-generation random markov-chain haxe markov random-generation markov-text haxelib markov-namegen name-generator

markov-namegen-lib's Introduction

Markov Namegen logo

License Badge Build Status Badge

Markov Namegen is a Markov chain-based word generator library written in Haxe, made for procedural name generation. Run the demo here.

Screenshot

Features

  • Hundreds of customizable/combinable training data presets.
  • Katz backoff using high order models - look up to "n" characters back.
  • Sort and filter generated strings by length, start, end, content and regex matching.
  • Damerau-Levenshtein distance similarity sorting option.
  • Dirichlet prior parameter.

Usage

See the demo code for a complete worked example. Also see the library documentation.

Library Setup

Get the Markov Namegen library from GitHub or through haxelib.

Include it in your .hxml

-lib markov-namegen

Or add it to your Project.xml:

<haxelib name="markov-namegen" />

You can also transpile the library for use with different target languages by running the following from the root of the repository, and then checking the generated code in the bin folder:

haxe build.hxml

How It Works

The markov-namegen haxelib uses Markov chains to procedurally generate original words.

Using a set of words as training data, the library calculates the conditional probability of a letter coming up after a sequence of letters chosen so far. It looks back up to "n" characters, where "n" is the order of the model.

The generator can use several orders of models, each with memory n. Starting with the highest order models (models with bigger memories), it tries to get a new character, falling back to lower order models if necessary - an approach known as Katz's back-off model.

A Dirichlet prior is used to add a constant probability that any letter may be picked as the next letter. This acts as an additive smoothing factor and adds a bit more "randomness" to the generated output.

Countless words are generated, and are then filtered and sorted according to several tweakable criteria like length, start and end characters, similarity to a target word, and so on.

Markov Namegen Ports

Some users have ported and extended the Markov Namegen library to different programming languages. See:

Tips

  • The generator works by using Markov chains, and requires training data to build them. A hundred or more words within your chosen category is usually sufficient for good results.
  • Sort words by similarity to preferred "good words" using an edit distance metric, and pick the most similar and suitable results. There are a few edit distance measures provided in EditDistanceMetrics.hx.
  • To get best results the training dataset, model order and prior will need to be tweaked for the type of words you want to generate. If possible, keep the prior parameter low or zero. Filter words to suit: look at length, beginning, end, contents, edit distance limits and regex. Some of this done for you in NameGenerator.hx. If you prefer to do it your own way, subclass the Generator class.

Notes

  • Many of the concepts used for the generator were suggested in this article by Jeffrey Lund.
  • The haxelib is written in plain Haxe and so supports every Haxe target.
  • If you have any questions or suggestions then get in touch or open an issue.

License

  • Most of the training data bundled in the haxelib comes from sites like Wikipedia and census data sources over many years. CC-BY-SA 3.0 as a derivative from Wikipedia content will cover most of the content if you wish to use these for other purposes, but I provide no guarantee.
  • The haxelib code is provided under the MIT license.

markov-namegen-lib's People

Contributors

tw1ddle avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

Forkers

tqmeta imedadel

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.