Quantcast

HDF Server: 2016 HPCwire Readers' Choice Awards!

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

HDF Server: 2016 HPCwire Readers' Choice Awards!

Karen Tudor

 

September 28, 2016

 

Please support The HDF Group and vote HDF Server for Best Use of HPC in the Cloud, and Best HPC Software Product or Technology in HPCWire’s 2016 Readers’ Choice Awards. https://www.hpcwire.com/2016-hpcwire-readers-choice-awards/.  Two days are left to vote!

 

HDF Server is a Python-based web service that enables full read/write web access to HDF data – it can be used to send and receive HDF5 data using an HTTP-based REST interface.

 

While HDF5 provides powerful scalability and speed for complex datasets of all sizes, many HDF5 data sets used in HPC environments are extremely large and cannot easily be downloaded or moved across the internet to access data on an as-needed basis.  Users often only need to access a small subset of the data.  Using HDF Server, data can be kept in one central location and content vended via well-defined URIs.  HDF Server enables exploration and analysis of the data while minimizing the number of bytes that need to be transmitted over the network.

 

By providing a web services native interface to HDF5 data,

  • data providers can consider hosting HDF5 data in a cloud/utility computing environment at a fraction of the existing cost. Moreover,
  • HDF data hosted by the server can be made available to a global community of HPC-based computing users on a laptop browser from anywhere on the internet, breaking down barriers to expensive, traditional HPC.

 

Since HDF Server supports the full range of HDF data, providing read/write access for most HDF types, it enables some interesting scenarios such as:

·       Collaborative annotation of data sets

·       Compute clusters that use HDF Server for data access

·       Continually updated data shares (e.g. Stock Market quotes, sensor data)

·       Storing the analysis of the data (say, a visualization) with the original source data

 

As an example of HDF Server’s impact on the HPC community, The HDF Group’s collaboration with NASA on HDF Server is enabling NASA to advance its enterprise goal of shifting its computing to a more cloud-centric model intended to reduce NASA’s TCO for providing remote access to its massive stores of data.  It will enable greater use of NASA datasets in the public cloud and hence, better utilization of data for research and discovery.  By providing a cost effective data platform, potentially much more of the available data could be brought into the public cloud.

 

Also, by removing the need to manage files and providing high throughput data access, data pipeline processes can be managed more efficiently.  For supercomputer centers, the outputs of simulation data could be off-loaded from expensive distributed file systems to private cloud object stores for analysis and research.  Read more at https://www.hdfgroup.org/2016/09/hpcwire-hdf-server-best-use-of-hpc-cloud-awards/

 

Make your voice heard before it’s too late!  Polls are open for the HPCwire Readers’ Choice Awards until September 30, 2016.

 

Register with HPCwire as a reader and vote for HDF Server as Best User of HPC in the Cloud at https://www.hpcwire.com/2016-hpcwire-readers-choice-awards/.

 

 

From: David Pearah
Sent: Wednesday, September 28, 2016 6:54 PM
To: Karen Tudor <[hidden email]>
Subject: Re: HDF Server: 2016 HPCwire Readers' Choice Awards!

 

Can you please something to me + Dax before sending out... the Blog post itself would be way too long.

 

-- dave


From: Karen Tudor
Sent: Wednesday, September 28, 2016 6:49:33 PM
To: David Pearah
Subject: RE: HDF Server: 2016 HPCwire Readers' Choice Awards!

 

Will check – I honestly don’t remember!  If not will do right now.

 

Meanwhile, here is the retweet https://twitter.com/hdf5

 

kt

 

 

 

 

From: David Pearah
Sent: Wednesday, September 28, 2016 6:45 PM
To: Karen Tudor <[hidden email]>
Cc: Dax Rodriguez <[hidden email]>
Subject: Fw: HDF Server: 2016 HPCwire Readers' Choice Awards!

 

Karen,

 

Hello... see below. Did a Forum announcement go out?

 

-- dave

 


From: Miller, Mark C. <[hidden email]>
Sent: Wednesday, September 28, 2016 6:36 PM
To: David Pearah
Cc: Elena Pourmal
Subject: Re: HDF Server: 2016 HPCwire Readers' Choice Awards!

 

Hi David,

 

That is great news.

 

I am just curious but did an announcement about this go out on the hdf-forum? 

 

Reason I ask is that I don't recall seeing anything about it there and if not, might be a good thing to do.

 

Mark

 

-- 

Mark C. Miller, LLNL

 

From: David Pearah <[hidden email]>
Date: Wednesday, September 28, 2016 at 4:15 PM
To: "Miller, Mark C." <[hidden email]>
Cc: Elena Pourmal <[hidden email]>
Subject: HDF Server: 2016 HPCwire Readers' Choice Awards!

 

Mark,

 

FYI... Our new HDF Server platform has been nominated in two categories: 1. Best Use of HPC in the Cloud and 2. Best HPC Software Product or Technology. It would be greatly appreciated if you can share this with folks at LLNL and in your network to ensure that HDF gets the votes.... Voting closes on Sep 30.

 

Details below.

 

Thanks for your support!

 

-- dave

 

 


From: HPCwire Subscriber Services <[hidden email]>
Sent: Wednesday, September 28, 2016 10:38 AM
To: David Pearah
Subject: Last Call to Vote for the HPCwire Readers' Choice Awards!

 

 

 

To view this email in your browser, click here.

 

                                                    

Last chance to vote for the
HPCwire Readers' Choice Awards...
Don't miss out!

Just two days remain until the 2016 HPCwire Readers' Choice Awards draw to a close! Weigh in on who in the HPC community deserves top honors in 2016. But hurry! Polls close this Friday, September 30 at 11:59 PM PT. These outstanding individuals and organizations are counting on you for your support, so don't delay! 


DON'T MISS YOUR CHANCE! CAST YOUR BALLOT TODAY!

Remember HPCwire readers who actively vote during the elections will decide the winners. It's an honor and a privilege for us to present these highly coveted awards at SC each year, but we can't do it without your active participation. 

Make your voice heard! Help tell the story of HPC in 2016 by submitting your nominations for the HPCwire Readers' Choice Awards now!


 

ACT NOW!

Election polls close on September 30, 2016 at 11:59pm PT. Winners will be notified following election results. The final presentation of these prestigious and highly anticipated awards to each organization's leading executives will take place live during SC '16 in Salt Lake City, UT. The finalist(s) in each category who receive the most votes will win this year's awards. Open to HPCwire readers only. Participation by Tabor Communications employees, its affiliates, extended staff and their families is strictly prohibited.


_______________________________________________
Hdf-forum is for HDF software users discussion.
[hidden email]
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

HDF Server: 2016 HPCwire Readers' Choice Awards!

Karen Tudor

 

September 28, 2016

 

Please support The HDF Group and vote HDF Server for Best Use of HPC in the Cloud, and Best HPC Software Product or Technology in HPCWire’s 2016 Readers’ Choice Awards. https://www.hpcwire.com/2016-hpcwire-readers-choice-awards/.  Two days are left to vote!

 

HDF Server is a Python-based web service that enables full read/write web access to HDF data – it can be used to send and receive HDF5 data using an HTTP-based REST interface.

 

While HDF5 provides powerful scalability and speed for complex datasets of all sizes, many HDF5 data sets used in HPC environments are extremely large and cannot easily be downloaded or moved across the internet to access data on an as-needed basis.  Users often only need to access a small subset of the data.  Using HDF Server, data can be kept in one central location and content vended via well-defined URIs.  HDF Server enables exploration and analysis of the data while minimizing the number of bytes that need to be transmitted over the network.

 

By providing a web services native interface to HDF5 data,

  • data providers can consider hosting HDF5 data in a cloud/utility computing environment at a fraction of the existing cost. Moreover,
  • HDF data hosted by the server can be made available to a global community of HPC-based computing users on a laptop browser from anywhere on the internet, breaking down barriers to expensive, traditional HPC.

 

Since HDF Server supports the full range of HDF data, providing read/write access for most HDF types, it enables some interesting scenarios such as:

·       Collaborative annotation of data sets

·       Compute clusters that use HDF Server for data access

·       Continually updated data shares (e.g. Stock Market quotes, sensor data)

·       Storing the analysis of the data (say, a visualization) with the original source data

 

As an example of HDF Server’s impact on the HPC community, The HDF Group’s collaboration with NASA on HDF Server is enabling NASA to advance its enterprise goal of shifting its computing to a more cloud-centric model intended to reduce NASA’s TCO for providing remote access to its massive stores of data.  It will enable greater use of NASA datasets in the public cloud and hence, better utilization of data for research and discovery.  By providing a cost effective data platform, potentially much more of the available data could be brought into the public cloud.

 

Also, by removing the need to manage files and providing high throughput data access, data pipeline processes can be managed more efficiently.  For supercomputer centers, the outputs of simulation data could be off-loaded from expensive distributed file systems to private cloud object stores for analysis and research.  Read more at https://www.hdfgroup.org/2016/09/hpcwire-hdf-server-best-use-of-hpc-cloud-awards/

 

Make your voice heard before it’s too late!  Polls are open for the HPCwire Readers’ Choice Awards until September 30, 2016.

 

Register with HPCwire as a reader and vote for HDF Server as Best User of HPC in the Cloud at https://www.hpcwire.com/2016-hpcwire-readers-choice-awards/.

 

 

 

 

To view this email in your browser, click here.

 

                                                    

Last chance to vote for the
HPCwire Readers' Choice Awards...
Don't miss out!

Just two days remain until the 2016 HPCwire Readers' Choice Awards draw to a close! Weigh in on who in the HPC community deserves top honors in 2016. But hurry! Polls close this Friday, September 30 at 11:59 PM PT. These outstanding individuals and organizations are counting on you for your support, so don't delay! 


DON'T MISS YOUR CHANCE! CAST YOUR BALLOT TODAY!

Remember HPCwire readers who actively vote during the elections will decide the winners. It's an honor and a privilege for us to present these highly coveted awards at SC each year, but we can't do it without your active participation. 

Make your voice heard! Help tell the story of HPC in 2016 by submitting your nominations for the HPCwire Readers' Choice Awards now!


 

ACT NOW!

Election polls close on September 30, 2016 at 11:59pm PT. Winners will be notified following election results. The final presentation of these prestigious and highly anticipated awards to each organization's leading executives will take place live during SC '16 in Salt Lake City, UT. The finalist(s) in each category who receive the most votes will win this year's awards. Open to HPCwire readers only. Participation by Tabor Communications employees, its affiliates, extended staff and their families is strictly prohibited.


_______________________________________________
Hdf-forum is for HDF software users discussion.
[hidden email]
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5
Loading...