With the HPC User Forum this past week, we saw several High-Performance Computing (HPC) related news announcements. Starting off, Hyperion, who established the Forum in 1999, shared that HPC in the cloud is gaining traction, with new major growth areas coming from AI/ML/DL, big data analytics, and non-traditional HPC users from the enterprise space.
Univa, in turn, introduced Navops Launch 2.0. The newest version of its platform is focused on simplifying enterprise HPC workloads migration to the cloud. It also announced the expansion of its Navops Launch HPC cloud-automation platform to now support the Slurm workload scheduler. And, HPE announced ML Ops, a container-based solution that supports ML workflows and lifecycles across on-premises, public cloud and hybrid cloud environments.
HashiCorp announced the beta version of Clustering for HashiCorp Terraform Enterprise. According to a blog announcement, the new Clustering functionality enables users to easily install and manage a scalable cluster that can meet their performance and availability requirements. The clustering capability in Terraform Enterprise includes the ability to scale to meet workload demand, enhanced availability and an easier installation and management process.
HashiCorp is partnering with VMware to support the Service Mesh Federation Specification. A new service mesh integration between Consul Enterprise and NSX-SM will allow traffic to flow securely beyond the boundary of each individual mesh, enabling flexibility and interoperability.
While we’re discussing service mesh, Kong announced a new open source project called Kuma. In a press release, Kuma is described as a universal control plane that addresses the limitations of first-generation service mesh technologies by enabling seamless management of any service on the network. Kuma runs on any platform – including Kubernetes, containers, virtual machines, bare metal, and other legacy environments.
In other news, ScyllaDB announced a new project — Alternator. The firm describes the open-source software in a press release as enabling application- and API-level compatibility between Scylla and Amazon’s NoSQL cloud database, Amazon DynamoDB, allowing DynamoDB users to migrate to an open-source database that runs anywhere — on any cloud platform, on-premises, on bare-metal, virtual machines or Kubernetes.
First introduced at re:Invent last year, AWS just announced GA of Amazon Quantum Ledger Database (QLDB). QLDB is a ledger database that is intended as a system of record for stored data. According to Amazon, it maintains a complete, immutable history of all committed changes to the data that cannot be updated, altered, or deleted. The QLDB API allows you to cryptographically verify that the history is accurate and legitimate, making it ideal for finance, ecommerce, manufacturing, and more.
To gain better understanding of network flow and avoid legwork typically associated with this, Amazon has introduced the availability of additional metadata that can now be included in Flow Log records. Amazon notes that enriched Flow Logs allow operators to simplify their scripts or remove the need for post-processing altogether, by reducing the number of computations or look-ups required to extract meaningful information from the log data. For example, operators can choose to add metadata such as vpc-ic, subnet-id, instance-id, or tcp-flags.
AWS Service Catalog introduced the ability to get visibility of portfolio and product budgets with integration to AWS Budgets. The newly added feature means that users can now make and connect budgets with portfolios and products and track spend to them.
Having worked recently on a QuickSight project for a customer, our DevOps consultants enjoyed these two articles on how to Federate Amazon QuickSight access with Okta for single-sign on to QuickSight and Create advanced insights using Level Aware Aggregations in Amazon QuickSight which illustrates several examples how to perform calculations on data to derive advanced and meaningful insights.
Read Flux7’s newest article, Flux7 Case Study: Technology’s Role in the Agile Enterprise, in which we share our journey to becoming an Agile Enterprise. In this story of how we at Flux7 have moved through the process, this article shares how we have adopted specific supporting technologies to further our agile goals.
Join us at Flux7 as we and AWS Present a High Performance Computing Immersion Day on October 11, 2019, in Houston, TX. Attendees to the hands-on training session will learn about services such as Batch, Parallel Cluster, Elastic Fabric Adapter (EFA), FSX for Lustre, and more in an introductory session. Register Here Today.