Pittsburgh Supercomputing Center democratises HPC as a service

High performance computing (HPC) can be a powerful tool for driving the profound breakthroughs needed to cure disease, protect the environment and deepen our understanding of our universe. But to maximise its impact, HPC must be accessible to researchers and scientists. So the Pittsburgh Supercomputing Center leveraged HPE technology to build Bridges: a supercomputer that’s as easy to use as a laptop.

Pittsburgh Supercomputing Center Logo

Upping the ante on artificial intelligence

Artificial intelligence until now has been constrained by the massive amounts of data and computational power needed to run algorithms. The Bridges supercomputer from the Pittsburgh Supercomputing Center brings advances enabling researchers to tackle big real-world problems.

Play Video
2:48
Play supercomputing poker video

A casino in Pittsburgh. Four of the world’s top poker players. An AI programme named Libratus. Who won? Bet on Libratus.

The artificial intelligence (AI) programme – written by researchers from Carnegie Mellon University (CMU) – calculated a strategy. And every night of the 20-day tournament, Libratus analysed what had happened that day so it could adapt to improvements the humans were making in their strategies. This AI has now surpassed the best human poker players. While the promise of AI has beckoned since the 1960s, there has been tremendous progress in AI over the last few years, driven by new AI algorithms.

Behind Libratus was a new type of supercomputer called Bridges. Funded by the National Science Foundation (NSF), Bridges was designed by the Pittsburgh Supercomputing Center (PSC) to converge AI with HPC and Big Data – and bring it within reach of researchers nationwide. Not only is Bridges super-powerful, it’s designed to be accessible through software interfaces that don’t require specialised programming skills. PSC makes Bridges available at no charge for open research in a wide range of fields, from genomics to social sciences, and by arrangement, to industry.

The stakes are high. While heads-up no-limit Texas Hold’em poker has become the leading benchmark in evaluating progress in algorithms for strategic reasoning under imperfect information, the algorithms used to solve it are application independent and apply to a host of important strategic reasoning settings. The real payoff will be for people and the planet. Bridges democratises supercomputing by making it available and user-friendly. Only the strongest proposals are chosen, through a highly selective peer-reviewed process. Researchers are using Bridges to study how to make the energy grid more efficient, how species respond to environmental change, the causes of lung disease – and many other high-impact problems that once were too big to solve.

1

Computer beats 4 top poker players

$17.2M

National Science Foundation funding for Bridges
  • "The poker project studied strategic reasoning under imperfect information. Real-world applications include negotiation, business strategy optimisation, strategic pricing, cybersecurity and medical treatment planning – how do you steer a person's T cells to fight cancer?"

    Prof. Tuomas Sandholm, Founder and Director, Electronic Marketplaces Laboratory, Carnegie Mellon University, and Founder and CEO, Strategic Machine, Inc

Supercomputing for solving super problems

The Pittsburgh Supercomputing Center provides researchers with access to supercomputers for solving the most challenging problems in science and engineering – including treating complex diseases and protecting the environment.

Abstract image representing complex mathematical problems

PSC provides university, government and industrial researchers nationwide with access to powerful and otherwise prohibitively expensive systems for HPC, data analytics and management, and communications.

PSC empowers researchers to solve the most challenging problems in science and engineering – including treating complex diseases, protecting the environment and other critical issues facing humanity.

The centre is a leading partner in Extreme Science and Engineering Discovery Environment (XSEDE), the National Science Foundation cyberinfrastructure programme. PSC is a joint effort of Carnegie Mellon University and the University of Pittsburgh, with support from federal agencies, the Commonwealth of Pennsylvania and private industry.

1986

Year established

6,600

Principal scientists and engineers served

10,824

Research grants
  • "Our users are solving problems that matter: diseases, earthquakes, economics, security. They do that on PSC’s converged HPC/HPDA systems, which are purpose built for the applications of today and tomorrow."

    Nick Nystrom, Interim Director, Pittsburgh Supercomputing Center

Bringing advanced supercomputing to non-programmers

PSC wanted to make HPC resources more accessible to a broader swath of the research community. That meant building a supercomputer for people whose core skillset is science and research, not programming.

Abstract image representing complex computational complexity

Detecting cyberattacks. Curing breast cancer. Predicting severe storms. A common thread among these vexing challenges is their computational complexity. No ordinary computer can crunch calculations on a large enough scale to help researchers understand them. And the alternative – that class of high-powered systems known as supercomputers – tends to be expensive and complex to build and manage.

That’s where PSC comes into the picture. Supported by the National Science Foundation and other funding, PSC provides HPC resources at no charge to researchers studying everything from neuroscience and the causes of cancer to meteorology and the national economy.

PSC’s traditional user base used to include engineers, chemists and physicists – people who typically brought some specialised HPC skills. Now, PSC is bringing its resources to researchers who are experts in their fields but might never have programmed a computer. To reach these new communities, PSC delivers HPC muscle through the types of software interfaces researchers are accustomed to using on their laptop PCs.

0

Charge to use PSC resources for open research

0

Computer programming required to use HPC
  • "We wanted to bring HPC to people who have never used it before. Everybody now has access to large data sources, such as genomic databases and data from social media. User-friendly supercomputing helps them leverage this data to solve complex problems."

    Nick Nystrom, Pittsburgh Supercomputing Center

Delivering HPC as a service

In creating Bridges, PSC had to bring together breakthrough levels of supercomputing storage, memory and processing power – and make it all available through desktop interfaces already familiar to most researchers.

As it planned the new supercomputer it calls Bridges, PSC faced two types of technical challenges.

One was to bring together breakthrough levels of supercomputing storage, memory and processing power. Bridges needs massive memory, for example to accelerate assembly of large genome sequences from small DNA fragments from days to hours. It must perform rapid calculations on problems split into small components, such as computing the energy use of hundreds of buildings over many time cycles. It needs AI capabilities, such as those that Libratus used to play poker, applied to problems of biology, chemistry and materials science.

The other challenge was to make all this available through the applications, languages and research paradigms already familiar to researchers. These include software tools such as Python, R, MATLAB and browser-based gateways used by tens of thousands of researchers. This barrier-free access allows researchers to amp up their current projects without having to learn specialised HPC skills.

Unprecedented power with desktop convenience: PSC set out to create HPC as a service.

1.35

Petaflops computational speed

10PB

Of persistent storage support advanced data management and community data collections

96

High-end GPUs
  • "We wanted to bring together large memory, GPUs and large numbers of nodes, so researchers could run analytics they cannot run any other way. And we wanted to give them web-browser access so they wouldn’t have to become programmers."

    Nick Nystrom, Interim Director, Pittsburgh Supercomputing Center

Supercomputing muscle with laptop ease

Bridges is a uniquely capable, easy-to-use resource for empowering diverse communities by bringing together HPC and Big Data.

Abstract image representing Bridges supercomputer

PSC’s flagship HPC system, Bridges, runs applications that accelerate discovery in the physical sciences, biology, economics, business and policy, and even the humanities.

Bridges is a uniquely capable petascale resource for empowering diverse communities by bringing together HPC, AI and Big Data. Its richly-connected set of interacting nodes and active storage systems offers exceptional flexibility for data analytics, simulation, workflows and gateways, leveraging interactivity, parallel computing, the Spark processing engine and the Hadoop programming framework. NVIDIA graphics processing units (GPUs) enable deep learning and accelerate simulations. Bridges is a heterogeneous system: Thanks to software written at PSC and Intel’s new OmniPath Architecture, scientists can apply different parts of the supercomputer to different portions of their computational problems, allowing productive reuse of existing applications and accelerating results.

What’s more, Bridges is designed to support familiar, convenient software and environments for both traditional and nontraditional HPC users. It’s supercomputing as easy to use as your laptop.

~400

Researchers currently using Bridges

153

U.S transplant centers optimise kidney donation exchange
  • "Working with HPE Pointnext, we identified the exact Hewlett Packard Enterprise server solutions, coupled with the Omni-Path Architecture, to make our vision of Bridges a reality."

    Nick Nystrom, Interim Director, Pittsburgh Supercomputing Center

The jackpot winner: All of us

Diverse projects yield important new insights.

Since 1986, more than 36,000 users, 6,800 distinct principal scientists and engineers, and over 11,000 distinct grants at 1,525 affiliations and research centres in 53 states and territories have used PSC computing resources. One generation after another, it's been an evolution of more memory and faster processing to better data storage and accessibility. Bridges is the best yet.

Four times a year, researchers may apply for time on Bridges. Diverse projects have launched this way. One team is exploring the factors that cause cancer, lung disease and brain function, drawing on genomic, imaging and other Big Data. Another is searching hundreds of thousands of historical documents for clues to the history and life experiences of Black women in the United States from the 1700s onward. Yet another is studying neutrino behavior for new insights into basic laws of physics and the origin of the Universe.

It's not about poker, it’s about life. The jackpot winner is mankind.

  • "We’re seeing people in departments of philosophy, English, political science, economics, and business – all contributing in ways that have never happened before, addressing issues that affect all of our lives."

    Nick Nystrom, Interim Director, Pittsburgh Supercomputing Center

Solution recipe

A new era of advanced supercomputing

Designed by PSC and built, racked, tested to PCS’s specifications by HPE Pointnext, Bridges leverages advanced technologies from HPE, Intel and NVIDIA to usher in a new era of supercomputing to tackle some of the world’s most complex challenges.