Data Engineering on Microsoft Azure Test 3

Select 1 option(s):

– allows multiple users to run queries at the same time while minimising latency
– can run workloads developed in Python, R and SQL
–  reduce overall costs
Which cluster type would you recommend?

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

Which storage solution would you recommend?

Select 1 option(s):

Which Azure service would you recommend in order to perform aggregations on the raw events that were archived by the real-time analytics service? The service should support Hive scripts.

Select 1 option(s):

What would you suggest for a real-time analytics service?

Select 1 option(s):

What would you suggest for the prediction service – service to predict potential failures, based on the real-time data?

Select 1 option(s):

What would you suggest for data ingestion service?

Select 1 option(s):

What would you suggest for orchestration, scheduling, and monitoring of the batch processing pipeline?

Select 1 option(s):

-fully managed database engine with 99.99% SLA with storage latency between 5 and 10 ms
-the architectural model is based on a separation of computing and storage layer
-whenever database engine or operating system is upgraded, some part of underlying infrastructure fails, or if some critical issue is detected in SQL Server process, Azure Service Fabric will move the stateless SQL Server process to another stateless compute node.
Which service tier would you recommend?

Select 1 option(s):

– compute and storage are on a single node
–  compute (SQL Server Database Engine process) and storage (locally attached SSD) are deployed in a four-node cluster, using technology similar to SQL Server Always On Availability Groups
– offers a  recovery point objective (RPO) of 5 sec and Recovery time objective (RTO) of 30 sec for 100% of deployed hours.

Which service tier would you recommend?

Select 1 option(s):

Which Cosmos DB configuration would enable for failover not to be necessary to minimize loss of availability and data?
Please select the correct answer.

Select 1 option(s):

You were asked to architect a new solution and put these costs down.
You proposed a solution to use the vertical data partitioning and separate all data from the column DocumentID into another table in a cheaper Azure SQL Database.
Does the solution meet the goal?

Select 1 option(s):

What would you choose for raw telemetry data ingestion?

Select 1 option(s):

Which services would you choose for real-time analytics and data visualisation? Please select correct answers.

Select 2 option(s):

What would you choose for a real-time prediction service?

Select 1 option(s):

You proposed to separate the first 100,000 rows into a new table, the next 100,000 into another table etc.
Does the solution meet the goal?

Select 1 option(s):

Your task is to propose a frictionless migration for apps and modernisation in a fully managed service ensuring near 100% compatibility with the latest SQL Server on-premises Database Engine. Which deployment model would you choose?

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

Which solution would you recommend?

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

Is this meet the requirements? Please, select the correct answer.

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

Only the application accessing the data can perform the encryption
The client application must have the access keys for encrypting and decrypting the data
The data must not appear in plaintext in the database
The strongest encryption method must be used on the database
The application should be able to search on select data values
Which of the following would you use as the encryption method for Searchable data?

Select 1 option(s):

You have to decide on which services will be used for each layer.
Which of the following would you choose as the service to use Service B?

Select 1 option(s):

Which of the following should be the underlying storage type for the exported data?

Select 1 option(s):

Ensure the database is encrypted at rest
Ensure that when sensitive data is accessed from the columns, it is encrypted in transit
Which of the following would you use for the following requirement?
“Ensure the database is encrypted at rest”

Select 1 option(s):

Which of the following could be used for Layer 1?

Select 1 option(s):

Ingest data from an on-premise SQL Server
Create pipelines that can integrate data and also run notebooks
Be able to develop notebooks that can be used to transform data
Be able to load the data into a massive parallel processing data for analysis
Which of the following would you use as the service to integrate the on-premise data onto the cloud?

Select 1 option(s):

A company is responsible for designing a new data engineering solution. The solution would be used by a media company that has offices in the following locations

• New York
• Manchester
• Singapore
• Melbourne

Current environment:

• The current solution stores millions of images on a physical server that is located in the New York office.
• Around 2 TB of images are added every day
• Currently the images are not being organized properly
• It becomes difficult to search for images
• The images need to have object and color tags generated
• The tags are stored in a document database that is queries by SQL
• The New York office also has a Microsoft SQL Server database that stores customer data

Proposed environment:

• All of the images and any customer data needs to be transferred to Azure.
• On-premise servers need to be decommissioned
• A proper analytical processing solution must be in place for customer related data
• There should be a proper image object and color tagging solution in place
• All expenses must be minimized
• The tagging data must be uploaded from the New York Office location
• Tagging data must be replicated to regions where other offices are located
• The customer data must be analyzed using Spark clusters
• The cluster should allow for parallel processing of data
• Power BI must be used to visualize transformed customer data
• There should be a facility to backup data if disaster recovery is required
• All the data in the cloud must be encrypted at rest and in transit
• Images must be replicated globally

You need to meet the storage requirements for the image tagging data. Which of the following would you configure for the data store in the New York location?

Select 1 option(s):

Which of the following would you use for the triggering of jobs?

Select 1 option(s):

Select 1 option(s):

skillcertlab_sales
The table would be 500 GB in size
A column named SalesDate would be used extensively in the WHERE clause in queries
A column named SalesProduct would be used extensively in JOIN operations
A column named SalesRegion is used for grouping
Around 75% of the records are related to one of the 40 region values of the SalesRegion column
skillcertlab_invoice
The table would be 6 GB in size
A column named SalesDate and SalesProduct would be used extensively in the WHERE clause in queries
A column named SalesRegion is used for grouping
You need to ensure query performance is optimized for each table.
Which of the following would you use as the Distribution type for the skillcertlab_sales table?

Select 1 option(s):

Information on course sales group by course category and price range
Reflect new course purchases
Ensure optimal performance
Which of the following can be used as the data format?

Select 1 option(s):

A company currently works with the local transportation sector. The company is responsible for building solutions that will help in improvement of traffic and safety.

Current requirements:

The company is currently managing the following systems:

Traffic sensors have been installed at different road junctions to monitor traffic. The sensors capture the following data

• Time
• Location in terms of latitude and longitude
• Speed in km per hour
• The license plate number
• The Length of the vehicle in meters

A sample of the data sent is shown below

{

“time” : “2019-10-15T22:15:25.72511745”,

“location” : {

“type” : “Point”,

“coordinates”:[ 22.4, 2.4] },

“speed” : 44.5,

“plate_number” : “22333W”,

“length” : 5.2

}

The traffic sensors will also capture images of the vehicle from time to time

Requirements:

Below are the various requirements for the various systems:

The Traffic Sensor data:

• The sensors must only be able to add items to a collection named “CompanySensorDt”
• The insertion rate of the data must be maximized
• Once every 2 months, traffic sensor data must be analyzed to check for any malfunctions
• The collection “CompanySensorDt” must reside in Cosmos DB
• The impact of the storing the vehicle images on the collection throughput must be minimized

The Company_track system:

• This system should be able to report on data that is related to specific plate number.
• The report data would come from the “CompanySensorDt” collection
• Business users must be able to filter on vehicles that drive over a specific speed limit

The Company_planning application:

• The data for this application must be stored in an Azure SQL database
• The data in the database would be sharded
• The data would be loaded from the “CompanySensorDt” collection once a week using Azure Data Factory
• A manual trigger would be used to transfer the data

Security:

• Azure Active Directory should be used for all services wherever possible
• The license plate information must not be visible in the “Company_planning” database
• If there is an unauthorized usage of the “Company_planning” database, the security team must be notified immediately
• Data must be stored for a maximum of 5 years

Other requirements:

• Costs should be minimized wherever possible
• The reports for the “Company_track” application must execute as quickly as possible
• An SLA of 75% is permitted for the “Company_planning” application
• It must be ensured that all data is replicated to multiple geographic locations to prevent any sort of data loss.

You have to design the “Company_planning” database. You decide to include a nonclustered columnstore index to improve performance. Is this an ideal implementation?

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

Provide the ability for data engineers to view all the rows for the customers
The data engineers should not be able to view the credit card information of the customers
Which of the following would you implement for this requirement?

Select 1 option(s):

Must be optimized to carry out batch processing activities
Must support autoscaling
Must support scaling at the cluster level
Which of the following would you implement for this requirement?

Select 1 option(s):

Select 3 option(s):

Which of the following would you use as the authentication method for Azure Databricks?

Select 1 option(s):

Which of the following would you use as the authentication method for Data Lake storage?

Select 1 option(s):

Only the application accessing the data can perform the encryption
The client application must have the access keys for encrypting and decrypting the data
The data must not appear in plaintext in the database
The strongest encryption method must be used on the database
The application should be able to search on select data values
Which of the following would you use as the encryption method for Non-Searchable data?

Select 1 option(s):

Which of the following service would you use for Layer 2?

Select 1 option(s):

Which of the following service would you use for Layer 3?

Select 1 option(s):

Select 1 option(s):

You have to decide on which services will be used for each layer.
Which of the following would you choose as the service to use Service A?

Select 1 option(s):

You have to decide on which services will be used for each layer.
Which of the following would you choose as the service to use Service C?

Select 1 option(s):