Giter VIP home page Giter VIP logo

unit-19-blockchain-with-python's Introduction

Unit-19-Blockchain-with-Python

Background

Your new startup is focusing on building a portfolio management system that supports not only traditional assets like gold, silver, stocks, etc, but crypto-assets as well! The problem is, there are so many coins out there! It's a good thing you understand how HD wallets work, since you'll need to build out a system that can create them.

You're in a race to get to the market. There aren't as many tools available in Python for this sort of thing, yet. Thankfully, you've found a command line tool, hd-wallet-derive that supports not only BIP32, BIP39, and BIP44, but also supports non-standard derivation paths for the most popular wallets out there today! However, you need to integrate the script into your backend with your dear old friend, Python.

Once you've integrated this "universal" wallet, you can begin to manage billions of addresses across 300+ coins, giving you a serious edge against the competition.

In this assignment, however, you will only need to get 2 coins working: Ethereum and Bitcoin Testnet. Ethereum keys are the same format on any network, so the Ethereum keys should work with your custom networks or testnets.

Dependencies

  • PHP must be installed on your operating system (any version, 5 or 7). Don't worry, you will not need to know any PHP.

  • You will need to clone the hd-wallet-derive tool.

  • bit Python Bitcoin library.

  • web3.py Python Ethereum library.

Instructions

Project setup

  • Create a project directory called wallet and cd into it.

  • Clone the hd-wallet-derive tool into this folder and install it using the instructions on its README.md.

  • Create a symlink called derive for the hd-wallet-derive/hd-wallet-derive.php script into the top level project directory like so: ln -s hd-wallet-derive/hd-wallet-derive.php derive

    This will clean up the command needed to run the script in our code, as we can call ./derive instead of ./hd-wallet-derive/hd-wallet-derive.php.

  • Test that you can run the ./derive script properly, use one of the examples on the repo's README.md

  • Create a file called wallet.py -- this will be your universal wallet script.

Setup constants

  • In a separate file, constants.py, set the following constants:

    • BTC = 'btc'
    • ETH = 'eth'
    • BTCTEST = 'btc-test'
  • In wallet.py, import all constants: from constants import *

  • Use these anytime you reference these strings, both in function calls, and in setting object keys.

Generate a Mnemonic

  • Generate a new 12 word mnemonic using hd-wallet-derive or by using this tool.

  • Set this mnemonic as an environment variable, and include the one you generated as a fallback using: mnemonic = os.getenv('MNEMONIC', 'insert mnemonic here')

Deriving the wallet keys

  • Use the subprocess library to call the ./derive script from Python. Make sure to properly wait for the process.

  • The following flags must be passed into the shell command as variables:

    • Mnemonic (--mnemonic) must be set from an environment variable, or default to a test mnemonic
    • Coin (--coin)
    • Numderive (--numderive) to set number of child keys generated
  • Set the --format=json flag, then parse the output into a JSON object using json.loads(output)

  • You should wrap all of this into one function, called derive_wallets

  • Create an object called coins that derives ETH and BTCTEST wallets with this function. When done properly.

You should now be able to select child accounts (and thus, private keys) by calling coins[COINTYPE][INDEX]['privkey'].

Linking the transaction signing libraries

Now, we need to use bit and web3.py to leverage the keys we've got in the coins object. You will need to create three more functions:

  • priv_key_to_account -- this will convert the privkey string in a child key to an account object that bit or web3.py can use to transact. This function needs the following parameters:

    • coin -- the coin type (defined in constants.py).
    • priv_key -- the privkey string will be passed through here.

    You will need to check the coin, then return one of the following functions based on the library:

    • For ETH, return Account.privateKeyToAccount(priv_key)
    • For BTCTEST, return PrivateKeyTestnet(priv_key)
  • create_tx -- this will create the raw, unsigned transaction that contains all metadata needed to transact. This function needs the following parameters:

    • coin -- the coin type (defined in constants.py).
    • account -- the account object from priv_key_to_account.
    • to -- the recipient address.
    • amount -- the amount of the coin to send.

    You will need to check the coin, then return one of the following functions based on the library:

    • For ETH, return an object containing to, from, value, gas, gasPrice, nonce, and chainID. Make sure to calculate all of these values properly using web3.py!
    • For BTCTEST, return PrivateKeyTestnet.prepare_transaction(account.address, [(to, amount, BTC)])
  • send_tx -- this will call create_tx, sign the transaction, then send it to the designated network. This function needs the following parameters:

    • coin -- the coin type (defined in constants.py).
    • account -- the account object from priv_key_to_account.
    • to -- the recipient address.
    • amount -- the amount of the coin to send.

    You may notice these are the exact same parameters as create_tx. send_tx will call create_tx, so it needs all of this information available.

    You will need to check the coin, then create a raw_tx object by calling create_tx. Then, you will need to sign the raw_tx using bit or web3.py (hint: the account objects have a sign transaction function within).

    Once you've signed the transaction, you will need to send it to the designated blockchain network.

    • For ETH, return w3.eth.sendRawTransaction(signed.rawTransaction)
    • For BTCTEST, return NetworkAPI.broadcast_tx_testnet(signed)

Send some transactions!

Now, you should be able to fund these wallets using testnet faucets. Open up a new terminal window inside of wallet, then run python. Within the Python shell, run from wallet import * -- you can now access the functions interactively. You'll need to set the account with priv_key_to_account and use send_tx to send transactions.

Bitcoin Testnet transaction

  • Fund a BTCTEST address using this testnet faucet.

  • Use a block explorer to watch transactions on the address.

  • Send a transaction to another testnet address (either one of your own, or the faucet's).

Local PoA Ethereum transaction

  • Add one of the ETH addresses to the pre-allocated accounts in your networkname.json.

  • Delete the geth folder in each node, then re-initialize using geth --datadir nodeX init networkname.json. This will create a new chain, and will pre-fund the new account.

  • Add the following middleware to web3.py to support the PoA algorithm:

from web3.middleware import geth_poa_middleware

w3.eth.setGasPriceStrategy(medium_gas_price_strategy)
  • Due to a bug in web3.py, you will need to send a transaction or two with MyCrypto first, since the w3.eth.generateGasPrice() function does not work with an empty chain. You can use one of the ETH address privkey, or one of the node keystore files.

  • Send a transaction from the pre-funded address within the wallet to another, then copy the txid into

Submission

  • Create a README.md that contains the test transaction screenshots, as well as the code used to send them. Pair the screenshot with the line(s) of code.

  • Write a short description about what the wallet does, what is is built with, and how to use it.

  • Include installing pip dependencies using requirements.txt, as well as cloning and installing hd-wallet-derive. You may include the hd-wallet-derive folder in your repo, but still include the install instructions. You do not need to include Python or PHP installation instructions.

  • Upload the project to a new GitHub repository.

  • Celebrate the fact that you now have an incredibly powerful wallet that you can expand to hundreds of coins!

Challenge Mode

  • Add support for BTC.

  • Add support for LTC using the sister library, lit.

  • Add a function to track transaction status by txid.

unit-19-blockchain-with-python's People

Contributors

cboitz88 avatar

Stargazers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.