By using new technologies in our everyday lives, enormous amounts of data are produced. 59 zettabytes of data were produced in 2020 in comparison to 2 zettabytes a decade ago. it is estimated that in 2021 this number will increase by 25%. just to provide you with a better picture – 1 zettabyte equals to a trillion of gb. fancy terms such as “big data” do not necessarily mean better information. According to the famous saying “less is more,” at our soc (security operations center), we strive to monitor and filter enormous amounts of data in a smart way, so that we can spot any suspicious data which could indicate danger. Our “filters” are of course specific software tools, but the most important is still human knowledge. Analysts of different levels (so-called tier analysts) perform specific analytic filtering roles in order to “catch” any suspicious events. But how do they manage that? Just keep on reading.
Remember the well-known and popular lego bricks which we all probably played with when we were kids? Actually, entire generations have been growing up with them. Some still have them at home, and some have new lego bricks that can be used for building a dream image. Mine, for instance, is the star destroyer. The forgotten lego bricks in the basement are like a huge pile of data, which you do not know what to do with, what it is telling you, and how you put it together – because you don’t have the instructions anymore or you’re missing some parts. Let’s say you received a lego set for the best star wars spaceship. It has 4784 pieces which came in different packets so that you could build it easily. All you need is time and you can make it, as well as a lot of lego bricks (“data”) to build a star destroyer (“structured information”). When you finish, you can see the result. It is a 7.5 x 5 cm star destroyer, or in this case, a piece of useful information.
You have put so much of your time, resources, coffees, happy and sad moments into building lego bricks (managing data), so that you could admire the result. For instance – you had more than four thousand pieces, you made everything right and used all the pieces, now everyone can see it, and most of all even touch it, which means that there is no place for making mistakes, but at the end, you made one – someone touched it and it suddenly broke into pieces. You don’t have the pieces separated in packets anymore, you do not now where some of them belong, and you just have too many lego bricks (“data”). after this incident, you don’t know what to do with it because it all looks the same. Now you only have one option; you must ask for help.
In “lego world,” that means that you go to the lego website, write down the lego set id, and it turns out that they can help you with a different set of instructions. The beauty of the lego bricks is that you’re not restricted to building just one thing with one package. There are plenty of options. The instructions can give you some guidelines but then you can figure out what else can be created and which lego bricks should be used. As a parallel, in information technology or data world, we can ask experts for help. The approach requires gathering all data in order to apply the solution to a problem. Data quality is key. there is no sense in making bad decisions just to make them fast. Experts of security operational centers (soc) are constantly receiving a lot of different data, sometimes too much, and that is why there are many data analysts on different tiers. The tier 1 analyst is the level 1 analyst who receives and checks the data, decides which information will help him/her to resolve the incident, and puts all pieces of information he/she gets together to see the whole picture, and then the puzzle is solved.
The tools that help the analysts to perform their job, such as an antivirus program, siem (security information and event management), and edr (endpoint detection and response) just send the data. The tier 1 analyst is the main hero who knows how to read the collected data and interpret the information in the correct way to answer the question we are most interested in – “is it an incident or not?” when the tier 1 analyst completes his/her job and notices that there’s a problem or an incident, he/she sends the information with all the data to tier 2 and tier 3 analysts, who then check the findings and start gathering new data and new information from a customer. It’s just like when you break and lose some lego bricks of your lego final product, check what you can do with the rest of them, and you decide to build something new. but when you are watching it, you notice that you could do something even better, so you start gathering different lego shapes and upgrading your product. As i have already mentioned before, soc only tends to receive quality data. Some data is indicative, some is not related or indicative yet. soc analysts are experts who know which data belongs together and what kind of information they can give us. if you would receive too much data or that data was mixed, you also wouldn’t know what you are looking at and what you can do with all of it if you’re not using the right equipment. That is why we use different applications, rules, queries, and analytic tools that show where the data came from and what it is telling us. the point is to collect enough data and only the right one, therefore if it is mixed or some of it is lost, we can still use it, read it, and get the message. But to collect the right one and build the information, we produce billions of other data and information that must be saved somewhere in the world on our smart phones, computers, servers, and clouds. Therefore, it is not a coincidence that the quantity of data grows so fast. And it will keep growing. To have a better picture about the soc analysts roles, you can check their tasks in the table below.
Maintains and manages the entire team (recruitment and training)
Reviews incident reports and manages the escalation process
Develops and executes the crisis communication plan to all of the stakeholders
Deals with compliance reports and supports the audit process
Evaluates the SOC performance metrics and communicates with business leaders
Let me ask you this – how much data do you think you produce in one day? Thanks to the invention of mobile technology such as smartphones and tablets along with innovations in mobile networks and wi-fi networks, the creation and consumption of data is constantly growing. 2.5 quintillion bytes (a billion multiplied by a billion) of data is produced by humans every day and the question that arises is “how to handle all this data?” therefore, the ability to extract important data and get useful information is key and there is a lack of such expert knowledge in the world.