Second in a series of posts recreating the forward pass of GPT2 in C++ from scratch. In this post we'll be going through the token and position embedding process that converts our integer token IDs into vectors of floating point numbers that can be passed to the transformer layers. We'll also go through the unembedding process, converting the output of the transformer layers into probabilities for the next token.
First in a series of posts recreating the forward pass of GPT2 in C++ from scratch. In this post we'll be tokenizing the input text, and converting it into a sequence of integers that can be fed into the model.
We now extend the previous post and use metaplex core to create an options trading program!
Metaplex Core is a new standard for creating NFTs on the Solana blockchain. It is way cheaper, simpler, and offers more functionality than the old SPL standard. In this post we'll introduce the basics for how to make use of Core on-chain, creating a collection of NFTs with on chain attributes, and transferring them to others.
RLHF is a very interesting technique for training an AI from human feedback. This post introduces the basic concepts with a simple example that doesn't need a lot of the technical details from the full implementation. We'll be able to build on it though over the next few posts to end up with an Agent that can play Atari games using a human to provide feedback on its performance
The next in a series of posts that introduces the Token-2022 program. We perform a deep dive into one of the most interesting new features - the transfer hook.
The first in a series of posts that introduces the Token-2022 program. In this part we create an on-chain mint that can handle a subset of the extensions, including automatic transfer fees.
We are excited to announce the launch of our first app, DaoPlays Pokemon! Play through the original Pokemon Red as part of a DAO, with votes for the next move happening in real time on the Solana blockchain, and raise money for a range of great charities!
In this post we are going to build on our previous posts to build a charitable token auction program, where a users chance of winning is proportional to the size of their bid. They will also be able to decide how much of their bid we keep, and how much we donate to charity, as well as selecting which charity we donate to from a set of provided options.
Here we describe our process for monitoring the Solana blockchain for interactions with an on-chain program, and then storing those interactions in a database so that we can update the state of an app in real time as each new block is produced.
We go through the process of setting up a 'pay what you want' token launch where participants get to choose how much of the payment goes to charity, and get a bonus if they pay more than the current average
Continuing our random numbers theme, we extend the previous post by looking at seeding your on-chain random number generator using a combination of Pyth (a price oracle) with the Xorshift and Murmur based methods from the previous post
For our next blog post we are discussing on-chain random number generation with Solana. In particular we'll be benchmarking a few different methods for performing RNG for those times when you just need a bit of random sauce in your DApp. Depending on how you do it you could save yourself an order of magnitude in compute time!
At DaoPlays we are interested in using blockchain technology to build apps that bring people together. At the moment there isn't much to see, but for now you can check out our blog as we continue to bring our first Solana app into it's public beta on devnet in just a few weeks!