Azure Data Factory Interview Questions and Answers

Azure Data Factory is Orchestration tool for data transfer pipelines on Azure portal. These pipelines ae having multiple components and having understanding of each component is quite important to for showcasing the knowledge of azure data factory.

        

Below are the list of questions which are must know to test the one's knowledge to test the azure data factory understanding.

These can help interviewers and interviewee both to understand the tool functionality.

1. What are different component or Activities you have used in azure data factory.
2. Explain difference between the Dataset and Linked Service in Data Factory?
3. What is Integration Runtime in Azure data factory?
4. What are the different Integration runtime in Azure Data Factory?
5. How do the if activity in Azure data factory works. Explain with example?
6. What if For Each Activity and when to use For Each Activity?
7. Have you used Lookup Activity in Azure Data Factory?
8. What is linked Services and How to create one.
9. What are datasets in Azure Data Factory. Please Explain?
10. How to declare parameter in Azure Data Factory
11. How to schedule a Pipeline in Azure Data factory?
12. What is SSIS integration run time ? How to configure it.
13. Have you used azure custom activity and what are it uses?
14. How to handle fault tolerance in Azure Data Factory?
15. How to make pipeline parameters dynamically?

Tags: Azure Data Factory Interview Questions, ADF Interview Questions, ADF Question, ADF Questions and Answers, Azure Data factory Questions.

How to generate calendar in SQL Server?

How to generate calendar dates between two given dates. This post will show the query to create calendar table.

When there is any requirement to generate calendar you can generate programmatically and push it into a table.

CREATE TABLE CALENDAR(VDATE DATE)

DECLARE @MinDate DATE = '20181010',

        @MaxDate DATE = '20191010';

INSERT INTO CALENDAR

SELECT  TOP (DATEDIFF(DAY, @MinDate, @MaxDate) + 1)

        Date = DATEADD(DAY, ROW_NUMBER() OVER(ORDER BY a.object_id) - 1, @MinDate)

FROM    sys.all_objects a

        CROSS JOIN sys.all_objects b;

Tags: Generate dates between two dates ; calendar dates sql server ;sql calendar ; all dates;

Error in rJava::.jcall(driver@jdrv, "Ljava/sql/Connection;", "connect", : java.sql.SQLException: Network error IOException: Connection refused: connect

Error in rJava::.jcall(driver@jdrv, "Ljava/sql/Connection;", "connect", :

java.sql.SQLException: Network error IOException: Connection refused: connect

Why do I get java.sql.SQLException: "Network error IOException: Connection refused: connect" when trying to get a connection?

The "Connection refused" exception is thrown by jTDS when it is unable to connect to the server. There may be a number of reasons why this could happen:

The server name is misspelled or the port number is incorrect.

SQL Server is not configured to use TCP/IP. Either enable TCP/IP from SQL Server's Network Utility app or have jTDS connect via named pipes (see the URL format for information on how to do this).

There is a firewall blocking port 1433 on the server.

To check whether TCP/IP is enabled and the port is not blocked you can use "telnet <server_host> 1433". Until telnet doesn't connect, jTDS won't either. If you can't figure out why, ask your network administrator for help.

Wake up and Learn Big Data

Wake up and Learn BIG DATA:

I am going to start a tutorial series on big data for the SQL developers. This is the time you should learn big data and start improving your skills parallel to survive in current market scenario.

In this tutorial, I will be guide you through apache Hadoop installation, development and other big data technologies.

In current scenario, the companies are considering new technologies for their new solutions which will create new jobs so you need to consider these learnings for you profile improvement.

Course content:

1. What is big data:

2. Why Big Data is required.

3. Different big data technologies.

4. Back ground of apache Hadoop.

5. Prerequisite for installing Apache Hadoop.

6. Installing ubuntu with dual boot system.

7. Understanding basis architecture of Apache Hadoop.

8. Setting up machine for Hadoop.

9. Hadoop single node cluster installation.