Genomic data is quickly becoming a central part of the next generation of medicine. The future of treatments will be through precision medicine, as evidenced by the growing number of drugs targeting specific mutations, and this will require the processing of large volumes of data. Genomics data sets have grown considerably, and the solutions of the past are not going to solve up-and-coming problems with adequate performance and speed. In this post, the first of a series, Pivotal data scientists introduce a new perspective on how the re-architecture of genomics processing pipelines, using SQL on Hadoop and low-cost storage on HDFS, can propel this space by revolutionizing the processing and analysis of data.
The latest release of GemFire XD 1.4 is now available for download. Its biggest improvements include single hop inserts for 50% faster performance, and support for JSON document objects in SQL tables. This makes GemFire XD even better for write-intensive use cases, such as high-speed ingest. Also, now we can support use cases that need more schema flexibility to the otherwise well-defined relational structure of GemFire XD.
Pivotal today announced that it will fund the next two major releases of the Groovy and Grails through March 31st, 2015, after which it will no longer directly fund development on these open source projects. This post explains the plan to hand control of these projects to the community and other frequently asked questions.
The new release of MADlib 1.7 includes several new features, namely generalized linear models, decision trees, and random forest. These ready-to-use algorithms provide better features, performance, and ease of use for predictive analytics. In addition, each supports PivotalR and Predictive Model Markup Language (PMML) format. This post provides an overview of each algorithm along with links to the release notes and more.
“Build” is the monthly newsletter from Pivotal that provides a snapshot of the most relevant news and trends for architects and developers. This month we look at 2014 year-end reviews and 2015 predictions, top news about breaches, as well as other important news and articles on mobile, agile, and devops in the areas that are making the biggest impact in software development and architecture today.
One of the benefits of PaaS is that a whole swathe of complex detail is taken care of by the platform itself, enabling the developer to know that the application will be deployed correctly and in a supportable manner. In this episode, we take a journey into what the process entails and give you a taste of how easy it can be.
Pivotal For Good (P4G) has partnered with Crisis Text Line, whose trained specialists assist hundreds of at-risk teens every day, to use data science to understand and predict teens’ crisis needs. These insights will ultimately help foster data-driven improvements on Crisis Text Line’s current platform (e.g. their ‘switchboard’) and training/recruiting of their crisis specialists. This blog post is the first look into the challenge of measuring if texters feel their crisis situation was alleviated by an exchange with a specialist, and how they felt the conversation went.
In this post, we do a Q&A session with Pivotal's vice president of engineering for data, Gavin Sherry. Gavin has played a major role in developing a number of well-known data-centric products, including significant contributions to PostgreSQL. Before big data was common, he joined Greenplum to help build the massively parallel processing engine for analyzing petabytes of data. At Pivotal, he helped lead the development of HAWQ, creating a new era of data platforms with SQL on Hadoop. In this interview, he shares his history as well as his views on where the market is heading and how his products are being used to help companies become more data driven.
Based on the thoughts of our top Pivotal data scientists and big data thought leaders, this post offers a view into our top predictions of what will happen in the data science and big data space in 2015. With an incredibly dynamic and fast-paced market, the year is sure to experience tons of innovation and market maturation that will yield exciting examples of just how significantly expertly built algorithms can benefit businesses.