What Exactly is Big Data?

You hear the term big data all the time in the industry world. Today, it is thrown around very loosely which is why there is much mystery surrounding the definition.

The phrase is big data, and the meaning is unclear. This is a phrase that has only appeared within the last two years; so it is fairly new and difficult to narrow down the meaning. I would even go so far as to say that big data is an umbrella for a plethora of meaning. Even I have used it very fluently in my blog posts. So I feel that a definition is in order.

To put it very simply, big data is massive amounts of data. It starts out just as one line or point of data but then is combined with many other points related/connected to that first point. Big Data happens over time with all this data being collected on a second by second basis. All this data continues to build into massive amounts. At this point, the data becomes too much for commonly used software applications.

Big Data leads to the demand for a software application that is capable for handling the data and interpreting the meaning of all that data. Many trending applications are available that make it simple to see past data and real time data, which is very useful for planning for the future.

One example of a company that uses big data is Walmart. Every hour Walmart handles more than 1 million transactions. The data from these transactions can become very useful if you want to track what is a ‘big seller item’ and what is not. This is one of the more extreme examples.

One of the smaller operations might be a drilling fleet or an oil rig. Both of these examples have many points of data that are tracked and all that data can be very useful if collected and analyzed.

To be honest, there is much more that goes into the definition of big data; much more terminology and detail that I didn’t include. But this is the simple version. If you want a more detailed answer, my advice is google it.

Can Data Historians Help Curb Spills From Saltwater Waste in the Bakken?

I am very excited to announce the first in a series of guest posts from different employees here at Canary Labs. Information Solutions Consultant, Shawn Ebersole, writes about an event that happened very recently in the Oil and Gas industry:

"I saw in the news yesterday that in North Dakota 1 million gallons of saltwater, the equivalent of 24,000 barrels, leaked from a pipeline.  This caused untold damage to surrounding vegetation, and much worse, the contamination of Bear Den Bay. Bear Den Bay leads to Lake Sakakawea, which is the source of drinking water for the Fort Berthold Indian Reservation. Fortunately, officials believe the drinking water was not affected, but this event got me thinking about how the oil and gas industry can do a better job in preventing this from happening. A big way to prevent this would be the use of a process data historian with real-time and historical trending.

Transporting liquids and gases through pipelines is a very
efficient way to move large quantities of substances from
one place to another.

Before getting into how to use a data historian to monitor saltwater pipelines, it is helpful to understand more about the type of saltwater in the pipelines.  Saltwater is a byproduct that accompanies oil and gas as it is harvested from a well. This type of saltwater is 10 to 30 times saltier than seawater, so if leaked or spilled from a pipeline, it poses a high environmental risk to soil, plants and freshwater resources.

Careful means are taken to properly dispose of this type of saltwater, but unfortunately spills like I saw in the news, have been happening frequently in North Dakota. The reason for the increased number of spills is relative to the growth of oil production in the Bakken.  As of November 2013, North Dakota had 515 saltwater disposal wells and 2,127 saltwater pipelines.  

A bill backed by the Northwest Landowners Association in 2013 would have required the use of flow meters and cutoff switches on all gas and liquid transmission lines, including saltwater pipelines; the bill was voted down 86-4. The opponents of the bill claimed the requirements were too complex and expensive. Further legislation surrounding saltwater pipelines continues to be debated as the subject is becoming a focal point during the race for the Agricultural Commissioner.

After understanding the background of the saltwater waste situation in the Bakken, both environmentally and politically, I feel there will be a movement towards closer monitoring of the saltwater waste pipelines. When this happens the ability to store, visualize and report on data obtained from the flow meters, cutoff switches, etc…will be crucial, and it will be important for the oil and gas companies operating in the Bakken to have a high performing data historian."

Encouraging Education on Data

Because industries are pouring more and more resources into recording data and the benefits that come with it, there is a greater need for the next generation to be educated in this area. 

Just think about it; there are so many companies that are realizing the need for data and its use. Industries like Water & Wastewater, Oil & Gas, and Electric Utilities use big data on a daily basis. But do we really know how to use big data like we think we do? Just think about how many jobs in America deal with big data. With the use of data comes the need to be educated to use it to its best advantage. People need to know not only how to collect the data, but also use the software that records it. People need to know how to read the data and interpret the results. 

There is a Growing Need to Develop Classes
about Big Data

We have seen this need, and want to make a contribution to satisfying it. Canary Labs has extended an offer to engineering colleges across the country to help them develop a course that will benefit students going into these industries. 

This includes the use of our software to use to educate students on how to use historians and trending tools in the field. We also want to help by giving the college suggestions for course content. Our desire to see this need fulfilled is so strong that, we are even willing to make visits to the college to help them in person. We realize the value of education and we want to see more long-term jobs created; this offer is one way that we can help. 

Not only does this offer benefit the college, it also benefits the various industries who use big data. When companies look for new people to hire, they look for the best person suited to the position. People who have this knowledge have the advantage because these skills are in high demand, so it also benefits the student taking the class.

Education is key in building industries and making them stronger. 

If you know of a college that is interested in adding an engineering course about big data, have them contact us at 814-793-3770.