This episode reveals how Manifold Labs is building a transparent, real-time marketplace for GPU compute on Bittensor, moving from crypto-native incentives to a model designed to attract enterprise-level demand.
Introduction to Targon's Architecture
- Validators and Miners: The system uses a centralized set of validators that communicate with miners. Each miner runs a single "minor proxy," which is their sole point of contact with the Bittensor chain and the validators.
- CVMs (Confidential Virtual Machines): Behind each proxy, miners operate multiple CVMs. A CVM is a secure, isolated environment running on the miner's hardware, such as an 8x H200 node. The proxy reports the IP addresses and price bids for each of its CVMs to the validators.
- Bidding Process: Miners submit a simple list of IP addresses and their corresponding bids in cents per GPU per hour (e.g., $2.00/hr for each H200 in a cluster). This bid represents the "ask" price from the supply side.
The 72-Minute Interval and Price Discovery
- The Targon Tower: To ensure consistency, all validators reference the "Targon Tower," a centralized oracle providing a single source of truth for the TAO price, the maximum allowable bid for miners, and details on currently active auctions (e.g., the H200 auction).
- The Emission Pool: Validators calculate the "emission pool" at the start of each interval. This is the total USD value of TAO rewards flowing into Subnet 4 for that 72-minute period, which determines the total budget available to pay miners. Josh explains, "It is the US dollars of the 41 cut," referring to the 41% of emissions that go to miners and 41% to validators.
CVM Attestation and NVIDIA-Backed Security
- Attestation Reports: At the start of an interval, and then randomly throughout, validators request an "attestation report" from each CVM. This report is a cryptographically signed data blob containing GPU information, generated using keys baked directly into the NVIDIA hardware.
- NVIDIA Verification: Validators send this report to NVIDIA's servers to confirm its authenticity. This process provides a strong guarantee that the CVM is running on a legitimate H200 GPU, as only NVIDIA holds the keys to verify the hardware signature. Josh notes, "We're actually getting guarantees from NVIDIA themselves that whatever reports we're getting back from these CVMs are valid."
- Strategic Implication: This direct hardware verification is a key differentiator, providing a level of trust and quality control that is crucial for attracting serious users and preventing fraudulent miners from gaming the system.
The H200 Auction Mechanism Explained
- Bucket-Based Payouts: Bids are grouped into "rings" or buckets by price (e.g., all bids at $2.19, all bids at $2.20). The system starts by paying out the lowest-priced ring in full.
- Finding the Market Price: It continues paying out rings until it reaches a price point where the emission pool can no longer cover all the bids in that ring. The remaining funds are then distributed pro-rata among the CVMs in that final, partially-funded ring.
- Actionable Insight: This mechanism forces miners to bid their true operational cost. Bidding too high risks not getting paid at all, while bidding lower secures a payout. This creates a competitive environment that continuously discovers the real-time, market-clearing price for interruptible H200 compute.
The Vision for a CME of Compute
- Market Inefficiency: James highlights the lack of transparency, comparing the current state to "trading OTC Discord back in 2021." Targon aims to solve this by creating a public order book where the true cost of compute is visible to everyone.
- Decentralization as a Scalability Solution: Centralized superclusters like those built by OpenAI and xAI face immense power and logistical constraints. James proposes a more scalable model: "What you probably want if you could pull it off is, you know, a couple million dollars of hardware here, 30 million there, a hundred million there, and it's all connected."
Bootstrapping Supply and Ensuring Quality
- Incentives as a Bridge: The TAO emissions provide "decentralized demand," paying miners to bring their hardware online before organic, paying customers arrive at scale. This ensures there is a ready supply of compute for Targon to sell.
- Avoiding the "Public Dumping Ground": James emphasizes that quality is paramount. To avoid becoming a marketplace for low-quality, "garbage compute," Targon uses the attestation process and plans to introduce more sophisticated quality checks. He warns, "You don't want to become a public dumping ground. That would be the end of Targon, I think, if that happened to us."
The Path to Self-Sustainability and Enterprise Adoption
- Compute Efficiency: A key focus is on "compute efficiency"—using less hardware to deliver the same quality of service. This allows Targon to serve more clients with its existing supply, a crucial step for scaling its business.
- Collateral and Non-Interruptible Compute: The next major step is introducing a collateral system. This will allow miners to post a bond to guarantee uptime and performance, creating a premium, "non-interruptible" tier of compute. This is essential for attracting enterprise clients who cannot tolerate downtime.
- Strategic Implication: For investors, the introduction of collateralized tiers is a major catalyst to watch. It signals a move from serving the interruptible spot market to competing for high-value, long-term enterprise contracts, unlocking a much larger addressable market.
Defining the "Institutional Miner"
- From Renting to Owning: This marks a shift from early miners who rented hardware from brokers to sophisticated operators who own their assets. This is crucial because Targon's thesis is to disintermediate the very brokers that renters rely on.
- Actionable Insight: The emergence of these institutional miners is a sign of market maturation. Researchers should track the composition of miners on the subnet, as a shift towards owner-operators indicates a more stable and professional supply base.
Final Advice for Bittensor Builders
- Josh's Technical Advice: He urges developers to build their core product first and not get overly constrained by Bittensor's initial tooling. "Figure out what your actual needs are and build the system around what the actual idea is, not necessarily around Bittensor itself."
- James's Business Advice: He stresses the importance of identifying the core commodity being produced and then figuring out how to sell it effectively. He advises builders to focus on creating a scalable, liquid market for their commodity, as that in itself is a powerful moat.
Conclusion
Targon's strategy demonstrates a clear path from a crypto-incentivized supply base to a revenue-generating, enterprise-focused compute marketplace. Investors and researchers should monitor the launch of collateralized compute tiers and the growth of organic revenue as key indicators of its potential to disrupt the traditional cloud market.
