Data Engineering on Microsoft Azure Test 12

Which are main reasons for adding a staging area into the architecture of a modern data warehouse? (Select all that apply)

Select 4 option(s):

Spark has optimized this operation by using a format called [?] which prevents the need for expensive serialization and de-serialization of objects in order to get data from one JVM to another.

Select 1 option(s):

Select 1 option(s):

Which component is best described by:
“It is created to perform a specific task by composing the different activities in the task in a single workflow. This can be scheduled to execute, or a trigger can be defined that determines when an execution needs to be kicked off.”

Select 1 option(s):

Select 1 option(s):

[?] is a Hadoop-compatible data repository that can store any size or type of data. The following are key features of [?]:
• Unlimited scalability
• Hadoop compatibility
• Security support for both access control lists (ACLs)
• POSIX compliance
• Zone-redundant storage

Select 1 option(s):

A dataset in Data Factory can be defined in a JSON format for programmatic creation as follows:
JSON
{
“name”: ““,
“properties”: {
“type”: ““,
“linkedServiceName”: {
“referenceName”: ““,
“type”: “LinkedServiceReference”,
},
“schema”: [
{
“name”: ““,
“type”: “”
}
],
“typeProperties”: {
““: ““,
““: ““,
}
}
}
Which of the JSON properties are required? (Select all that apply)

Select 3 option(s):

Select 1 option(s):

Synapse Spark can be used to read and transform objects into a flat structure through data frames. Synapse SQL serverless can be used to query such objects directly and return those results as a regular table. With Synapse Spark, you can transform nested structures into columns and array elements into multiple rows.
The steps show the techniques involved to deal with complex data types have been shuffled.
a. Flatten nested schema Use the function to flatten the nested schema of the data frame (df) into a new data frame.
b. Define a function for flattening We define a function to flatten the nested schema.
c. Flatten child nested Schema Use the function you create to flatten the nested schema of the data frame into a new data frame.
d. Explode Arrays Transform the array in the data frame into a new dataframe where you also define the column that you want to select.
Which is the correct technique sequence to deal with complex data types?

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

SSIS is primarily a control flow engine that manages the execution of workflows. Workflows are held in packages, which can be executed [?]. (Select all that apply)

Select 2 option(s):

Which of the following is best described by:
“You specify the script in cluster’s configuration by either writing it directly in the cluster configuration UI or storing it on DBFS and specifying the path in Cluster Create API. Any location under DBFS /databricks folder except /databricks/init can be used for this purpose.“

Select 1 option(s):

Which is best described by:
“Focuses on software-defined life cycles highlighting tools that emphasize automation.”

Select 1 option(s):

Which of the following are you able to load into Azure Synapse Analytics? (Select all that apply)

Select 6 option(s):

Select 1 option(s):

Select 1 option(s):

True or False: It is important to update the statistics after you load data or update large ranges of data, so that queries can benefit from the updated statistics information.

Select 1 option(s):

Select 1 option(s):

Select 3 option(s):

Which of the following is best described by:
“Organizations that don’t have existing spark implementations yet, get the functionality to spin up a spark cluster to meet data engineering needs without the overhead of the other Spark Platforms. Data Engineers, Data scientist, Data Platform Experts, and Data Analyst can come together within Synapse Analytics where the Spark cluster is spun up quickly to meet the needs. It provides scale in an efficient way for Spark Clusters and integrates with the one stop shop Data warehousing platform of Synapse.”

Select 1 option(s):

See the below command:
HTTP
GET https://[url-for-service-account]/?comp=list&include=metadata
What would this command return?

Select 1 option(s):

Select 1 option(s):

To optimize the load execution operations, recommendations are to reduce or minimize the number of simultaneous load jobs that are running or assigning higher resource classes that reduce the number of active running tasks.

Select 1 option(s):

[?] is a data flow object that can be added to the canvas designer as an activity in an Azure Data Factory pipeline to perform code free data preparation. It enables individuals who are not conversant with the traditional data preparation technologies such as Spark or SQL Server, and languages such as Python and T-SQL to prepare data at cloud scale iteratively.

Select 1 option(s):

Azure Data Factory is the cloud-based [?] and data integration service that allows you to create data-driven workflows for orchestrating data movement and transforming data at scale. You can build complex [?] processes that transform data visually with data flows or by using compute services such as Azure HDInsight Hadoop, Azure Databricks, and Azure Synapse Analytics.

Select 1 option(s):

[A] data is information that doesn’t reside in a relational database but still has some structure to it. Databases that hold documents are held in [B] format.

Select 1 option(s):

Select 1 option(s):

Both the real-time data and batch data is processed in a machine learning model to predict a maintenance schedule for each of the HGVs. This data is made available to the downstream application that third-party garage companies can use if an HGV breaks down anywhere in Europe. In addition, historical reports about the HGV should be visually presented to users.
Design A:

Design B:

Design C:

Which architecture would be best suited for the need?

Select 1 option(s):

The company has 10,000 employees. Most employees are located in Europe. The company supports teams worldwide.
AIM has two main locations: a main office in London, England, and a manufacturing plant in Berlin, Germany.
AIM plans to implement an Azure Cosmos DB database which will be replicated to four global regions where only the one closest to London will be writable. During events, the Cosmos DB will write 250,000 JSON each day and the consistency level must meet the following.
Requirements:
· The system must guarantee monotonic reads and writes within a session.
· The system must provide the fastest throughput available.
· Latency must be the lowest available.
As the expert, the team looks to you for direction. Which of the following consistency levels should you advise them to utilize?

Select 1 option(s):

Select 1 option(s):

Which aspects guide a user’s decision on the tool used to create a storage account? (Select two)

Select 2 option(s):

Select 1 option(s):

Select 1 option(s):

The process of consuming data streams, analyzing them, and deriving actionable insights out of them is called [?].

Select 1 option(s):

Select 3 option(s):

True or False: It is possible to reference data or variables directly across different languages in a Synapse Studio notebook.

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

Select 6 option(s):

Select 1 option(s):

Select 1 option(s):

What will happen?

Select 1 option(s):

Select 1 option(s):

• Permit us to store data in a format that more closely meets the original structure.
• Does not use the tabular schema of columns and rows found in most traditional database systems.
• Uses a storage model that is enhanced for the specific requirements of the type of data being stored.

Select 1 option(s):

Select 1 option(s):

Select 1 option(s):

In Azure Stream Analytics, a(n) [?] is a unit of execution.

Select 1 option(s):

Which of the following would be the best compute resource to use?

Select 1 option(s):

Select 1 option(s):

By default, what is the network rule set to?

Select 1 option(s):

Select 1 option(s):

Python
new_rows =
demo_df =

Select 1 option(s):

Review the following architecture designs.
Design A:

Design B:

Design C:

Which architecture would be best suited for the need?

Select 1 option(s):

Select 1 option(s):

Which of the following is best described by:
“You can limit the init script to run only on for a specific cluster’s creation and restarts by placing it in /databricks/init/ folder.”

Select 1 option(s):

Select 1 option(s):

Which is the least expensive option which will meet the requirement?

Select 1 option(s):

[?] is an encryption mechanism to help you protect Azure Synapse Analytics. It will protect Azure Synapse Analytics against threats of malicious offline activity. The [?] way will do so by is encrypting data at rest. [?] performs real-time encryption as well as decryption of the database, associated backups, and transaction log files at rest without you having to make changes to the application.

Select 1 option(s):

Apache Spark Structured Streaming is a fast, scalable, and fault-tolerant stream processing API. You can use it to perform analytics on your streaming data in [?].

Select 1 option(s):

Microsoft Azure Storage is a managed service that provides durable, secure, and scalable storage in the cloud. Azure Blob storage is an object storage solution optimized for storing massive amounts of unstructured data, such as text or binary data.
Azure Storage supports which kinds of blobs? (Select three)

Select 3 option(s):

Which of the following are valid kinds of Storage accounts? (Select three)

Select 3 option(s):

These methods are:
• Mapping Data Flows
• Compute Resources
• SSIS Packages
Mapping Data Flows provides a number of different transformations types that enable you to modify data. They are broken down into the following categories:
• Schema modifier transformations
• Row modifier transformations
• Multiple inputs/outputs transformations
Which transformations type is best described by:
“The Union transformation that combines multiple data streams.”

Select 1 option(s):

Table Characteristics:
• The file name is SalesHistory.
•  The table contains sales data from the past 36 months.
• The file is partitioned by month.
• The file contains 1.5 billion rows.
• The file has clustered columnstore indexes.
Required:
At the beginning of each month, data older than 36 months must be promptly removed from the SalesHistory file.
The IT team has created a list of possible actions that should be performed to create a stored procedure, but there is debate about which are valid and the required sequence of the tabled actions. See the proposed action list below.
Proposed Actions:
a. Create an empty table named SalesHistory_Current that has a duplicate schema as the SalesHistory table.
b. Drop the SalesHistory_Current table.
c. Copy the data to a new table by using CREATE TABLE AS SELECT.
d. TRUNCATE the partition containing the stale data.
e. Switch the partition containing the stale data from SalesHistory to SalesHistory_Current.
f. Execute a DELETE statement where the value in the Date column is more than 36 months ago.
As the Azure SME, Tony and the team look to you to select the correct actions and put them in order in preparation for creation of the stored procedure. Which of the below contains the correct items in the correct sequence for the required stored procedure?

Select 1 option(s):

Select 1 option(s):