How blockchain can create the world’s largest supercomputer, TechCrunch

How blockchain can create the world’s largest supercomputer

Ben Dickson is a software engineer and the founder of TechTalks.

As our desktop computers, laptops, mobile devices, etc. stand idly by for a yam-sized portion of the day, the need for computing resources is growing at a swift rhythm. Large IoT ecosystems, machine learning and deep learning algorithms and other sophisticated solutions being deployed in every domain and industry are raising the request for stronger cloud servers and more bandwidth to address the minute needs of enterprises and businesses.

So how can we make a more economic and efficient use of all the computing power that’s going to waste? Blockchain, the distributed ledger that’s gaining traction across various domains, might have the reaction to the dilemma by providing a platform that enables participants to lend and borrow computing resources — and make money in the process.

The rising challenges of computing

“There is a growing request for computing power from industries and scientific communities to run large applications and process thick volumes of data,” says Gilles Fedak, co-founder of iEx.ec, a distributed cloud computing platform.

Fedak names several domains, such as product simulation, deep learning and 3D rendering, where request for expensive computing resources and High-Performance Computing (HPC) is rising.

“The fattest challenge for supercomputing is the request to compress time,” says Jerry Cuomo, vice president of Blockchain for Business at IBM. “Business processes must now be ended at a significantly swifter tempo than before. The result is that the request for computing power is enlargening exponentially.”

David Sønstebø, founder of IOTA, a distributed ledger for IoT, also underlines the need to achieve real-time computation and overcome the lag caused by current cloud-based models. “The fattest problem for computation overall is that the devices generating data are not located close-by to the data centers that perform the analytics,” he says.

How distributed computing solves the problem

Compute resource sharing platforms such as SETI@home have existed for years. But they still depend on central brokers to distribute and manage tasks, which can make things complicated.

One of the fields where centralized and cloud-based computing falls brief is the Internet of Things, Sønstebø says. “As IoT grows, the need for distributed computing becomes an absolute necessity,” he says. Latency in round-trips, network congestion, signal collisions and geographical distances are some of the challenges faced when processing data produced at edge devices in the cloud. “Devices need to be able to trade computational resources with each other in real time so that the computational explosion can be distributed,” he says.

Some of the emerging lines of software will not be supported by centralized architectures at all, iEx.ec’s Fedak says, such as decentralized applications (DApps), which, among others, will power fog computing, distributed AI and parallel stream processing. “This class of application is enormously challenging because they’re both data and compute-intensive, and they don’t cope well with centralized infrastructure,” Fedak says.

Incentivizing resource sharing is also a problem with centralized models.

“If you look at the last 10-20 years’ of progress in virtualization, it’s demonstrable that setting up any kind of environment in a data center or on an individual computer has become much lighter,” says Julian Zawistowski , co-founder and CEO of distributed computing platform Golem. “But when it comes to actually renting the hardware, it still tends to be painful: comparing the offerings of different providers is complicated, and it takes fairly a bit of time and expertise to figure out the best solution for a given task.”

“The issue with getting payment involved is that you need to check whether the participants are actually performing the work and also integrate payment so that the provider of the compute capacity knows that running the computations is going to be worth its time,” says Preston Byrne, COO at Monax. This is effortless when you’re dealing with trusted entities such as the Amazon Web Services HPC platform, but not so when you’re dealing with knots that vary in hardware and power.

How distributed ledgers pack the gap

A distributed network of computers managed by blockchain and wise contracts can create a collective economy where anyone with a computer can borrow idle computing power and make a side income.

The peer-to-peer nature of the blockchain and distributed ledgers will also help budge computation closer to where the data is being generated, and avoid bottleneck round-trips to cloud servers.

Byrne suggests that while not being a computation platform itself, the blockchain can potentially create “a marketplace application that attacks the specific problem of linking buyers and sellers of compute time and permitting them to pay themselves in cryptocurrency without needing an intermediary like AWS.”

IOTA’s Sønstebø further elaborates on Byrne’s point and says that distributed ledgers “shine in renting out computation in the fog, i.e. at the edge of the network.” IOTA has developed a distributed ledger based on Tangle, a scalable design that gets rid of the blocks and introduces a Directed Acyclic Graph (DAG) that reduces transaction times and liquidates fees, which according to Sønstebø creates the backbone for an outsourced distributed on-demand computational trade model for M2M environments.

Golem, which recently raised $8.6 million in Initial Coin Suggesting (ICO), has created a peer-to-peer computation sharing platform on the Ethereum blockchain, which it dubs ‘Airbnb for computers.’ Golem enables application owners and individual users to rent the computing resources of other users and pay for it directly in cryptocurrency.

According to Eddy Azar, Growth Hacker at Golem, the platform has the potential to “reduce costs and increase speed in domains such as scientific research, machine learning and graphics rendering, while making it possible for anyone with an average or better computer to share resources and make a side income.”

After submitting tasks to the Golem network, requestors are matched with providers based on prices, reputations and machine spectacle registered on the ledger. Resources are then sent to the provider for processing and are sent back after the task is finished. The provider is paid if the results pass verification tests. A user’s reputation is built-up based on their success in completing tasks and making payments.

Developers can use Golem’s open-source code and task API to create program that uses the network and put it on Golem’s application registry, which Azar likens to an app store, and make it available for others to use and, if the developer so chooses, pay for.

iEx.ec is another distributed computing platform, which uses the Ethereum blockchain to create “a market network for applications, data, and computing resources, including HPC ones,” says Julien Béranger, the company’s Community Outreach Officer. “It means that everyone will be able to suggest their computing resources through brainy contract deployed on the blockchain.”

The platform uses Desktop Grid or Volunteer Computing to collect underutilized computing resources to execute very large parallel applications at a fraction of the cost of a traditional supercomputer. This is the model used in distributed computing platforms like SETI@Home, Folding@home and disributed.net.

The iEx.ec team hopes the combination will provide inexpensive, scalable and on-demand access CPU, GPU, data sets, storage and other resources.

Blockchain makes a big difference, iEx.ec’s Fedak believes. “Because the blockchain permits for a decentralized infrastructure, it can bring the data closer to their producers and consumers,” he says, “whereas with centralized cloud computing, data-centers tend to be located in remote areas.”

The request for computation will proceed to grow as we budge forward. Whether cloud servers will scale up to meet the requirements in resources, costs and speed is yet to be seen. In the meantime, the blockchain proposes an alternative that can open up fresh possibilities and succeed where previous technologies have failed.

Related video:

Leave a Reply

Your email address will not be published. Required fields are marked *

*