1 00:00:00,350 --> 00:00:01,460 Hey, what's up, gurus 2 00:00:01,460 --> 00:00:03,283 and welcome to a new section, 3 00:00:03,283 --> 00:00:07,540 Monitor Data Storage and Data Processing. 4 00:00:07,540 --> 00:00:09,260 In the grand scheme of things, 5 00:00:09,260 --> 00:00:11,700 we now find ourselves here, 6 00:00:11,700 --> 00:00:14,330 which congratulations, you are getting very, 7 00:00:14,330 --> 00:00:16,680 very, very close to the end of this course, 8 00:00:16,680 --> 00:00:19,050 and just about ready to take your exam 9 00:00:19,050 --> 00:00:22,750 and get your brand new data engineering certification. 10 00:00:22,750 --> 00:00:24,110 So with that, let's dive in 11 00:00:24,110 --> 00:00:26,533 and talk a little bit about this section. 12 00:00:28,520 --> 00:00:30,930 So in this section, we are going to be talking about 13 00:00:30,930 --> 00:00:33,220 how we develop a monitoring strategy 14 00:00:33,220 --> 00:00:35,070 with a focus on performance. 15 00:00:35,070 --> 00:00:38,182 How do we make things cost less, finish faster, 16 00:00:38,182 --> 00:00:40,130 become more streamlined, 17 00:00:40,130 --> 00:00:42,040 and we're really going to break this thought 18 00:00:42,040 --> 00:00:45,290 of performance into a couple of different terms. 19 00:00:45,290 --> 00:00:46,840 First is monitor. 20 00:00:46,840 --> 00:00:48,650 So we're going to talk about data pipelines, 21 00:00:48,650 --> 00:00:51,760 cluster performance, Azure Monitor metrics and logs, 22 00:00:51,760 --> 00:00:53,020 and what that means. 23 00:00:53,020 --> 00:00:55,300 And then the other side of that is going to be measuring. 24 00:00:55,300 --> 00:01:00,300 So, moving away from that pipeline performance kind of 25 00:01:00,460 --> 00:01:03,710 metric, into more how our queries are performing 26 00:01:03,710 --> 00:01:07,300 or looking at the performance of our data movement. 27 00:01:07,300 --> 00:01:09,294 So that's going to help us in a different way, 28 00:01:09,294 --> 00:01:12,180 one using more of a script-based methodology, 29 00:01:12,180 --> 00:01:14,640 and then one using more of that, hard coding 30 00:01:14,640 --> 00:01:16,770 what's actually happening with the system. 31 00:01:16,770 --> 00:01:19,450 So we're going to look at that in this section 32 00:01:19,450 --> 00:01:21,690 and then we're also going to talk about 33 00:01:21,690 --> 00:01:23,650 a variety of different data services. 34 00:01:23,650 --> 00:01:26,230 And it's very important that you focus on 35 00:01:26,230 --> 00:01:28,240 the service as we talk about this, 36 00:01:28,240 --> 00:01:30,450 because we're going to go over several of the services 37 00:01:30,450 --> 00:01:33,540 that we've been talking about through this entire course. 38 00:01:33,540 --> 00:01:35,490 A few key points to remember: 39 00:01:35,490 --> 00:01:38,180 1. Hey, this is not very code-based. 40 00:01:38,180 --> 00:01:39,610 So if you don't like the scripts, 41 00:01:39,610 --> 00:01:42,030 this is going to be a good section for you. 42 00:01:42,030 --> 00:01:43,530 Don't forget the service though. 43 00:01:43,530 --> 00:01:47,370 You do need to know where you access each concept. 44 00:01:47,370 --> 00:01:49,080 So when we talk about those concepts 45 00:01:49,080 --> 00:01:50,230 make sure that in your mind 46 00:01:50,230 --> 00:01:52,900 that you're tying that to Azure Synapse, 47 00:01:52,900 --> 00:01:54,940 or Azure Stream Analytics, 48 00:01:54,940 --> 00:01:57,340 or whatever the service is. 49 00:01:57,340 --> 00:01:59,070 And don't forget the scenario. 50 00:01:59,070 --> 00:01:59,903 This is true. 51 00:01:59,903 --> 00:02:00,736 We've talked about this 52 00:02:00,736 --> 00:02:02,830 at a couple of different points in this exam, 53 00:02:02,830 --> 00:02:05,992 but those scenarios is going to help you 54 00:02:05,992 --> 00:02:09,070 do better on the DP-203. 55 00:02:09,070 --> 00:02:12,640 So be thinking about how all of this ties together 56 00:02:12,640 --> 00:02:17,470 into that larger pipeline or that larger project. 57 00:02:17,470 --> 00:02:20,470 And so with that, hey, we finished our introduction. 58 00:02:20,470 --> 00:02:22,943 Let's jump into the first lesson and get started.