{"id":10254,"date":"2018-09-25T00:00:00","date_gmt":"2018-09-25T05:00:00","guid":{"rendered":"https:\/\/threecloud.wpengine.com\/post\/can-azure-data-factory-read-excel-files-from-data-lake\/"},"modified":"2022-11-30T09:12:03","modified_gmt":"2022-11-30T15:12:03","slug":"can-azure-data-factory-read-excel-files-from-data-lake","status":"publish","type":"post","link":"https:\/\/3cloudsolutions.com\/resources\/can-azure-data-factory-read-excel-files-from-data-lake\/","title":{"rendered":"Can Azure Data Factory Read Excel Files from Data Lake?"},"content":{"rendered":"<p>Today\u2019s post is in response to a question I was recently asked. It\u2019s about using Azure Data Lake Store with Azure Data Factory, in particular about the Copy Activity within Data Factory to read data from Azure Data Lake.<\/p>\n<p>Someone asked, If I have some Excel files stored in Azure Data Lake, can I use Data Factory and the Copy Activity to read data from the Excel files and load it into another sync data set (in this case a database)?<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/_o0OiEsvw54\" width=\"560\" height=\"315\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>The short answer \u2013 no. This may seem a bit confusing as we know that you can store virtually any type of file in Data Lake. However, that doesn\u2019t necessarily mean that Data Factory can read or consume files of any format out of Data Lake.<\/p>\n<p>I wanted to explain that key difference today as it\u2019s something to be aware of. To be more specific, Data Factory can consume files from Data Lake if it\u2019s in a JSON format, a text delimited, like a CSV file, or any of 3 Hadoop file structures, those being AVRO, ORC or Parquet files. With any of these formats you can use Azure Data Factory to read those from the Data Lake.<\/p>\n<p>Excel files can be stored in Data Lake, but Data Factory cannot be used to read that data out.<img decoding=\"async\" style=\"width: 298px; display: block; margin-left: auto; margin-right: auto;\" src=\"https:\/\/3cloudsolutions.com\/wp-content\/uploads\/2021\/09\/CanDataFactoryReadExcelFileFromDataLake.jpg\" alt=\"CanDataFactoryReadExcelFileFromDataLake\" width=\"298\" \/><\/p>\n<p>So, that&#8217;s my quick tip that I hope you found useful when working in Azure Data Factory and Data Lake.<\/p>\n<p>Need further help? Our expert team and solution offerings can help your business with any Azure product or service, including Managed Services offerings. Contact us at 888-8AZURE or\u00a0 <a href=\"mailto:sales@3cloudsolutions.com\">sales@3cloudsolutions.com<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Today\u2019s post is in response to a question I was recently asked. It\u2019s about using&mldr;<\/p>\n","protected":false},"author":32,"featured_media":9457,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","footnotes":""},"categories":[260],"tags":[],"class_list":["post-10254","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-ai","topics-blog"],"acf":[],"_links":{"self":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/10254","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/users\/32"}],"replies":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/comments?post=10254"}],"version-history":[{"count":0,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/10254\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media\/9457"}],"wp:attachment":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media?parent=10254"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/categories?post=10254"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/tags?post=10254"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}