What Exactly is Big Data?

You hear the term big data all the time in the industry world. Today, it is thrown around very loosely which is why there is much mystery surrounding the definition.

The phrase is big data, and the meaning is unclear. This is a phrase that has only appeared within the last two years; so it is fairly new and difficult to narrow down the meaning. I would even go so far as to say that big data is an umbrella for a plethora of meaning. Even I have used it very fluently in my blog posts. So I feel that a definition is in order.

To put it very simply, big data is massive amounts of data. It starts out just as one line or point of data but then is combined with many other points related/connected to that first point. Big Data happens over time with all this data being collected on a second by second basis. All this data continues to build into massive amounts. At this point, the data becomes too much for commonly used software applications.

Big Data leads to the demand for a software application that is capable for handling the data and interpreting the meaning of all that data. Many trending applications are available that make it simple to see past data and real time data, which is very useful for planning for the future.

One example of a company that uses big data is Walmart. Every hour Walmart handles more than 1 million transactions. The data from these transactions can become very useful if you want to track what is a ‘big seller item’ and what is not. This is one of the more extreme examples.

One of the smaller operations might be a drilling fleet or an oil rig. Both of these examples have many points of data that are tracked and all that data can be very useful if collected and analyzed.

To be honest, there is much more that goes into the definition of big data; much more terminology and detail that I didn’t include. But this is the simple version. If you want a more detailed answer, my advice is google it.

Can Data Historians Help Curb Spills From Saltwater Waste in the Bakken?

I am very excited to announce the first in a series of guest posts from different employees here at Canary Labs. Information Solutions Consultant, Shawn Ebersole, writes about an event that happened very recently in the Oil and Gas industry:

"I saw in the news yesterday that in North Dakota 1 million gallons of saltwater, the equivalent of 24,000 barrels, leaked from a pipeline.  This caused untold damage to surrounding vegetation, and much worse, the contamination of Bear Den Bay. Bear Den Bay leads to Lake Sakakawea, which is the source of drinking water for the Fort Berthold Indian Reservation. Fortunately, officials believe the drinking water was not affected, but this event got me thinking about how the oil and gas industry can do a better job in preventing this from happening. A big way to prevent this would be the use of a process data historian with real-time and historical trending.

Transporting liquids and gases through pipelines is a very
efficient way to move large quantities of substances from
one place to another.

Before getting into how to use a data historian to monitor saltwater pipelines, it is helpful to understand more about the type of saltwater in the pipelines.  Saltwater is a byproduct that accompanies oil and gas as it is harvested from a well. This type of saltwater is 10 to 30 times saltier than seawater, so if leaked or spilled from a pipeline, it poses a high environmental risk to soil, plants and freshwater resources.

Careful means are taken to properly dispose of this type of saltwater, but unfortunately spills like I saw in the news, have been happening frequently in North Dakota. The reason for the increased number of spills is relative to the growth of oil production in the Bakken.  As of November 2013, North Dakota had 515 saltwater disposal wells and 2,127 saltwater pipelines.  

A bill backed by the Northwest Landowners Association in 2013 would have required the use of flow meters and cutoff switches on all gas and liquid transmission lines, including saltwater pipelines; the bill was voted down 86-4. The opponents of the bill claimed the requirements were too complex and expensive. Further legislation surrounding saltwater pipelines continues to be debated as the subject is becoming a focal point during the race for the Agricultural Commissioner.

After understanding the background of the saltwater waste situation in the Bakken, both environmentally and politically, I feel there will be a movement towards closer monitoring of the saltwater waste pipelines. When this happens the ability to store, visualize and report on data obtained from the flow meters, cutoff switches, etc…will be crucial, and it will be important for the oil and gas companies operating in the Bakken to have a high performing data historian."

Encouraging Education on Data

Because industries are pouring more and more resources into recording data and the benefits that come with it, there is a greater need for the next generation to be educated in this area. 

Just think about it; there are so many companies that are realizing the need for data and its use. Industries like Water & Wastewater, Oil & Gas, and Electric Utilities use big data on a daily basis. But do we really know how to use big data like we think we do? Just think about how many jobs in America deal with big data. With the use of data comes the need to be educated to use it to its best advantage. People need to know not only how to collect the data, but also use the software that records it. People need to know how to read the data and interpret the results. 

There is a Growing Need to Develop Classes
about Big Data

We have seen this need, and want to make a contribution to satisfying it. Canary Labs has extended an offer to engineering colleges across the country to help them develop a course that will benefit students going into these industries. 

This includes the use of our software to use to educate students on how to use historians and trending tools in the field. We also want to help by giving the college suggestions for course content. Our desire to see this need fulfilled is so strong that, we are even willing to make visits to the college to help them in person. We realize the value of education and we want to see more long-term jobs created; this offer is one way that we can help. 

Not only does this offer benefit the college, it also benefits the various industries who use big data. When companies look for new people to hire, they look for the best person suited to the position. People who have this knowledge have the advantage because these skills are in high demand, so it also benefits the student taking the class.

Education is key in building industries and making them stronger. 

If you know of a college that is interested in adding an engineering course about big data, have them contact us at 814-793-3770.

The Canary Labs Commitment

At Canary Labs, we value our customers and want them to be the best in their respective industries. What does this mean? This means that we feel the need to create a program that that allows us to totally focus on our customers’ needs and give them the highest level of support and commitment that they deserve. This dedication towards our customers is why we created the CustomerCare program. 

Caring For Our Customer's Needs

When you subscribe to the CustomerCare program, you are protecting your investment. Often companies have to invest a good bit of money into data software to get the results and quality that they want and need. This investment needs protecting. Your CustomerCare package does exactly this. Also, you can choose the package that best fits your needs as a company which saves you money and gets you the most value out of your software purchase. You took a lot of care in making sure the software you chose was the best for your company's needs; in turn we want to live up to that expectation and provide you with the care that you deserve. 

This means that:

•  You Will ALWAYS Get the Latest Product Updates, Upgrades And Service Packs – It ensures that you will always get the latest version of your software product without any additional cost; every new release, version, feature, enhancement, and improvement which means you will always have the most current technology at your fingertips.

• You Receive On-Demand Updates – No more waiting for a CD in the mail. You can download the latest updates instantly. These updates are released regularly and when the need arises.

• Live Help Desk Personnel – Access to technical email or live help desk support from our team of highly experienced support professionals. This means avoiding that annoying automated voice that goes through eight different steps before finally getting a hold of the person you need to talk to. Being able to talk to a live person means that you can get the help you need faster. 

•  Remote Desktop Sharing – Ever had trouble explaining an issue and putting it into words? This is where our remote desktop sharing feature is very valuable. When a problem is too difficult to describe or has not been reproduced, we use this method to better understand the issue and the steps that are need to correct the situation.
  
  
• Product News Delivered Right To Your Desktop – Regularly receive product news and information about your solution directly from Canary Labs.

We want you to succeed at what you do. This is why we want to give you the best product and best service available to fulfill your needs and make your company more profitable. The whole point of our CustomerCare program is to support your daily work flow and decrease the amount of interruptions that occur. When you subscribe to it, you are not only protecting your investment, you are securing your future.

Using Data in the Drilling Industry

The use of data in today’s industries has greatly increased from what it once was. One specific industry is that of the drilling industry. What once was recorded only on paper by hand has now been passed to computers to manage and track. If I was in charge of keeping track of all that information, you can be sure there would be some mistakes made! Data is a big part of the drilling process and is used for a variety of reasons including for safety, management and analysis.

What once was all done by hand has now been passed to computers. This not only helps minimize mistakes, but it also allows more data to be produced. Now a timeline is available to the operation engineers and overseers to see what is happening at all times not only onsite but also remotely. In the past, this was done through fax or over the phone but the data was limited. However, today with the advancement of technology, all the data can be placed directly in front of you no matter where you are. 

One of the main reasons data is recorded, is for analysis. The data provides insight which enables the operator to see how to improve future well operations. 

In many regions, local and federal governments require well-operations and equipment reports to be submitted either electronically or through hard-copy. Tracking this data through historian software make this very simple for organizations to create these and manage these reports.   

So what does all this mean and how does it relate to you? Simple. If data has changed this one industry, improving and advancing it, don’t you think that data has the potential to improve your industry as well? We live in a world that is constantly changing and people are realizing how important information can be.

Data has the power to change. Change how we do things; change how we see things. We know that to improve something, we need to intimately understand how a system works. Data gives the understanding that companies need to profit and grow. This is what makes it valuable. This is why using data in the drilling industry has increased and made it the industry that it is today.

Source
http://petrowiki.org/Drilling_data_management

Counting the Cost: The Real Price of Data (PART 2)

In my last post, I talked about the benefits of having time-series data. Having the data has the potential to save your company thousands of dollars.  It saves you time when it comes to figuring out problems and it helps eliminate or minimize fines when the inspector rolls around. Now I want to talk about the real price of data. Yes, I have established pretty well that data is important and can save you money, but now I want to discuss what life looks like without the data. There are many instances where companies have regretted the decision not to record the data; and it cost them dearly.

What if an accident occurs at one of your production locations where all your data is lost? All the information about the equipment that was recorded was lost after the accident.  

What was the source that caused the accident? Could it have been prevented? Will it happen again? How can we prevent it from happening again at other locations?

Fines might occur costing millions of billions of dollars depending on the accident and what occurred. The greater the effect on the environment, the greater the cost.

With the Canary Historian, it backs all this important data up on a separate system so there is no loss if a disaster occurs. If this system is in place at the time of the incident, it will lead to answers. A company will know the answers to why it happened and how it happened. This knowledge is invaluable to company and can save millions in future costs.

More and more companies are realizing the big need for big data. This is why they are taking measures to build the security of their companies and utilizing the information that comes from big data. Producing the data does not produce money. Producing data gives you something that is much more valuable, insight.

When you have the data, you have knowledge. Knowledge about the equipment, knowledge about your operator’s ability to run the equipment, and knowledge about how to better run your organization. Problems are solved faster and more efficiently. Insight is given that gives you a better idea of how to run your company and become more profitable. And it helps provide security to the future of your business.

Many companies don’t realize the value of this knowledge. It provides a foundation on which you can base your decisions. It provides awareness to create a safer work environment. Lastly, it gives insight into how to make your company more efficient, saving you money. That’s the power of data!

Have you counted the cost?