What are the benefits of moving our analytics to the cloud? (link to presentation slides)
The elements of analytics are the same whether on premises or in the cloud. Cloud based tools for analytics can provide a platform that is far more extensible, economical and powerful than traditional on-premise. This session will review some cloud analytics use cases and how the tools from Microsoft combine to create business insight and value.
Azure Cloud Tools
Microsoft Intelligence (edited, previously Cortana Intelligence Suite) is a powerful combination of cloud based tools that manage data, provide analysis capability and store or visualize results. Together these tools represent the six elements of data analytics.
Microsoft Intelligence (edited, previously Cortana Intelligence Suite) is a powerful combination of cloud based tools that manage data, provide analysis capability and store or visualize results. Together these tools represent the six elements of data analytics.
The talk on Data Based analytics includes a demonstration of Data Lake, PolyBase, Azure SQL Data Warehouse, Power BI, and Azure Machine Learning. The links to Power BI and Azure ML will take you to the apps, each has a free account you can sign up and use for testing. I encourage you to sign up for the free offer for $200 in Azure Credits (United States based offer, at the time of this posting Oct. 11, 2016).
Analytics projects
According to Gartner analytics projects include 6 elements and there are common challenges for each of these elements that must be addressed in any analytics project:
1. Data sources - volume alone and the need to move large data sets
2. Data models - complexity of setup as they simulate business processes
3. Processing applications - data cleansing, remediation of bad data
4. Computing power - analysis requires considerable power
5. Analytics models - design of experiments and management of the models, model complexity
6. Sharing and storage of results - informative visualizations and results embedded in applications
Tools provided by cloud vendors provide assistance and in some cases, with far superior solutions to these issues.
The Cloud analytics tools are designed to address the challenges we’ve been discussing:
1) Scalability: Agility/ Flexibility
-large data sources –power them off when not in use
- heavy computing capability – pay only for what you use
- Stand up a new environment – pilot a new capability
- integrate data sources with multiple visualization and analytics environment
2) Economy –
- less expensive to stand up than hardware and software,
- fewer skills necessary in house for implementation, configuration, integration, use,
- management and maintenance of systems
3) Security
- Azure is designed for security from the ground up
- Microsoft spends $1B a year on security research – more than most security firms
- identity based security throughout the stack
- protection for disaster recovery, regulatory specific platforms to address security needs
4) Capability
- Integration with desktop tools for embedding visualizations, integrating predictive analytics
- Consumer technology style interfaces enable faster learning and require fewer skills than script based on premises tools
- Collaboration enabled by ties across Office 365 tools and Mobile capabilities
- Powerful servers can simply process far more data and analysis than most local servers
According to Gartner analytics projects include 6 elements and there are common challenges for each of these elements that must be addressed in any analytics project:
1. Data sources - volume alone and the need to move large data sets
2. Data models - complexity of setup as they simulate business processes
3. Processing applications - data cleansing, remediation of bad data
4. Computing power - analysis requires considerable power
5. Analytics models - design of experiments and management of the models, model complexity
6. Sharing and storage of results - informative visualizations and results embedded in applications
Tools provided by cloud vendors provide assistance and in some cases, with far superior solutions to these issues.
The Cloud analytics tools are designed to address the challenges we’ve been discussing:
1) Scalability: Agility/ Flexibility
-large data sources –power them off when not in use
- heavy computing capability – pay only for what you use
- Stand up a new environment – pilot a new capability
- integrate data sources with multiple visualization and analytics environment
2) Economy –
- less expensive to stand up than hardware and software,
- fewer skills necessary in house for implementation, configuration, integration, use,
- management and maintenance of systems
3) Security
- Azure is designed for security from the ground up
- Microsoft spends $1B a year on security research – more than most security firms
- identity based security throughout the stack
- protection for disaster recovery, regulatory specific platforms to address security needs
4) Capability
- Integration with desktop tools for embedding visualizations, integrating predictive analytics
- Consumer technology style interfaces enable faster learning and require fewer skills than script based on premises tools
- Collaboration enabled by ties across Office 365 tools and Mobile capabilities
- Powerful servers can simply process far more data and analysis than most local servers
How can my business benefit from analytics in the cloud?
Data, provided and used as a valuable asset of the firm provides leverage employees apply to problem solving activities. Fact based trend prediction leads to insights that provide business value.
Businesses taking advantage of the cloud to benefit from increased cloud computing power, the ability to handle large data sets and for the mobility provided by access to the analytics platform from any location.
Data, provided and used as a valuable asset of the firm provides leverage employees apply to problem solving activities. Fact based trend prediction leads to insights that provide business value.
Businesses taking advantage of the cloud to benefit from increased cloud computing power, the ability to handle large data sets and for the mobility provided by access to the analytics platform from any location.
Other articles that may help to answer this question are:
Power BI is a great starting point for moving analytics to the cloud
Power BI brings many customers their first exposure to cloud analytics. Companies find multiple benefits of collaboration between users, mobile access, and the experience of adopting a new way to use data. Workspaces provide secure areas to work together on Power BI solutions and are linked to Exchange groups and OneDrive folders where other collateral can be shared.
Storage in the cloud
Using Azure cloud based storage is relatively inexpensive, remotely accessible from anywhere, secure and in coming data is free (data moving out of your region is charged). Large data sets can be managed in Azure Blob Storage, Azure Data Lake, Azure SQL DW and Azure SQL Database.
Predictive Analytics with Azure Machine Learning
Azure ML provides a friendly tool for building machine learning experiments, cleaning and visualizing data. The environment provides familiar analytic tools for R and Python scripting, built in models for statistical analysis and a process for encapsulating trained models in web services as predictive experiments. Integration with Excel and other applications is simplified by the web service interface.
Questions:
Q1) In the PolyBase example does modeling the data by casting columns hinder performance of the data load in the "Create Table As" (CTAS) statement?
(Original posting left this question unanswered, edited to add the answer below)
In creating the External Table the columns must be of the same data type.
However, when querying the external table to use CTAS to populate a SQL DW table I found that using cast to change the datatype of the column was faster to complete the new table creation. This was true for two cases, one where I converted in the input column varchar2(20) to an Int and another where I converted the input varchar(100) to a Date data type. I suspect this is due to the increased speed of input for Int and Date data types over varchars, but it indicates that the original query time isn't different.
In creating the External Table the columns must be of the same data type.
However, when querying the external table to use CTAS to populate a SQL DW table I found that using cast to change the datatype of the column was faster to complete the new table creation. This was true for two cases, one where I converted in the input column varchar2(20) to an Int and another where I converted the input varchar(100) to a Date data type. I suspect this is due to the increased speed of input for Int and Date data types over varchars, but it indicates that the original query time isn't different.
Q2) Is it simple to switch from cold to hot in Azure Blob Storage?
In regions where these settings have been enabled (not East yet), they can be changed in the Configuration blade of the Storage Account.
Q3) When to use Data Lake in comparison to Blob Storage.
In the demo for this talk I read the NYC 2013 Taxi data from the 12 - 2+GB CSV files into Azure SQL DW using CTAS. At this time, Data Lake is still in preview, and we cannot yet use CTAS with Azure Data Lake. This forced me to use Azure Blob Storage.
Additoinal differences are that Data Lake is optimized for parallel analytics workloads and for high throughput and IOPS. Where Blob Storage is not optimized for analytics but is designed to hold any type of file. Data Lake will hold unlimited data and Blob Storage is limited to 500TB. There are cost differences too, I recommend the Azure Pricing Calculator.
I recommend the Microsoft article Comparing Azure Data Lake Store and Azure Blob Storage for details.
465 comments:
«Oldest ‹Older 401 – 465 of 465Awesome Niche ! Good Content, this article guide me to gain more knowledge, Thanks for Sharing keep update twice per week…………..
IELTS Test Center in Velachery|
IELTS Test Center in Chennai|
IELTS Test Center in Tharamani|
IELTS Test Center in Perungudi|
IELTS Test Center in Thambaram|
Wow such a nice blog, very usefull information. Thanks for sharing.
JAVA Training in Velachery |
Web Designing Training Center in Velachery |
Tally Training in Velachery |
Selenium Training in Velachery |
Summer Courses Training in Velachery|
The information you have here is really useful . It is truly supportive for us and I have accumulated some essential data from this blog.
Web Designing Training Center in Chennai |
Tally Training in Chennai |
Selenium Training in Chennai |
Summer Courses Training in Chennai|
JAVA Training in Chennai |
thanks for share
data science course in pune
informative blog
data scientist online course
Beautifull Content ! I Think This is the Best Article for this Year, Thanks for sharing ……………
Agile Certification in Velachery|
Agile Certification in Chennai|
Agile Certification in Tharamani|
Agile Certification in Perungudi|
Agile Certification in Thambaram
Your Blog is really an amazing content to read, its very useful for everyone. thanks for sharing such an wonderful post..
PMP Exam Center in Chennai | PMP Certification in Velachery | PMP Exams in Velachery | Online Certification in Chennai
This Article is really helpful for me. I like it. Thanks for sharing.
Hardware and Networking Training in Chennai |
AWS Training in Chennai|
Web Designing Training Center in Chennai |
Python Training in Chennai|
Tally Training in Chennai |
Dot Net Training in Chennai |
The Blog Content was Awesome !Thanks for sharing this unique blog keep posting more…..
Python Training in Chennai|
Tally Training in Chennai |
Dot Net Training in Chennai |
Hardware and Networking Training in Chennai |
AWS Training in Chennai|
Web Designing Training Center in Chennai |
Nice blog. You put Good stuff. All the topics were explained briefly. So easily understand for me. I am waiting for your next awesome blog. Thanks for sharing.
Python Training Institute in Velachery |
Python Training Institute in Chennai |
Python Training Institute in Tambaram |
Python Training Institute in Taramani|
Python Training Institute in Medavakkam
Wonderful information and really very much useful. Thanks for sharing and keep updating More like this……...
AWS Training in Chennai|
Python Training in Chennai|
Tally Training in Chennai |
Dot Net Training in Chennai |
Hardware and Networking Training in Chennai |
Web Designing Training Center in Chennai
Awesome information with unique content and it is very useful to know about the information based on blogs...
Web Designing Training Center in Chennai
AWS Training in Chennai|
Python Training in Chennai|
Tally Training in Chennai |
Dot Net Training in Chennai |
Hardware and Networking Training in Chennai |
Excellent post.. Thank you so much for sharing your nice blog with useful content with us....
ITIL Exam Center in Chennai | ITIL Exams in Velachery | ITIL Exam Center in Velachery | ITIL Exams in Perungudi | Online Certification in Chennai
Good information and really its very much useful Blog . Thanks for sharing and keep updating like this …….
GRE Exams in Chennai|
GRE Exams in Velachery|
GRE Exams in Tharamani|
GRE Exams in Perungudi|
GRE Exams in Thambaram
Excellent blog with valuable information..
MCSA Training Institute in Chennai | MCSA Training Institute in Velachery | MCSA Training Institute in Medavakkam | MCSA Training Institute in Tharamani
unique content and it is very useful to know about the information based on blogs...
Python Training in Tharamani|
CCNA Training in chennai |
Dot Net Training in thambaram |
Hardware and Networking Training in perungudi |
Web Designing Training Center in guindy
AWS Training in Velachery|
Excellent content! Thanks for sharing such a useful information.
Apache Spark Online Course
Best Apache Spark Online Course
“Excellent!” I have never seen blog like this. This post is really very interesting and effective. Kindly update your post soon.
Software Testing Training Institute in Velachery |
Software Testing Training Institute in Chennai |
Software Testing Training Institute in Tambaram |
Software Testing Training Institute in Taramani|
Software Testing Training Institute in Medavakkam
Good Niche ! Thanks for sharing such a wonderful blog here...
AWS Training in Velachery|
Hardware and Networking Training in Velachery |
Web Designing Training Center in Velachery
JAVA Training in Velachery|
CCNA Training in Velachery |
CCNP Training in Velachery |
Python Training in Velachery|
Nice post.. Its really an amazing with informative information and useful for everyone. Thanks for sharing your wonderful article..
AWS Certification in Chennai | AWS Exam Center in Chennai | AWS Exams in Velacheri | AWS Online Exams in Velachery | Online Certification in Chennai
Good Article ! I really Learned lot of information Thank you for updating such an informative content.
Certified Ethical Hacking Training in Chennai|
Certified Ethical Hacking Training in Velachery|
Certified Ethical Hacking Training in Tharamani|
Certified Ethical Hacking Training in Perungudi|
Certified Ethical Hacking Training in Thambaram
Excellent information. Thanks for sharing such a great blog with us.
Linux Training Institute in Chennai | Linux Training Institute in Tharamani | Linux Training Institute in Medavakkam | Linux Training Institute in Velachery
Excellent article.. Thanks for posting your informative information..
Final Year Project Center in Chennai | Final Year Projects in Velachery | Final Year Projects in Taramani | Final Year MBA Projects in Chennai | Final Year Projects in Perungudi | BE Project Center in Velachery
Hi, I am a big follower of your blog. The best thing is that your blog really informative. Thanks for your great information!
Selenium Training Institute in Velachery |
Selenium Training Institute in Chennai |
Selenium Training Institute in Tambaram |
Selenium Training Institute in Taramani|
Selenium Training Institute in Medavakkam
Awesome article you have shared, thank you so much for posting such a useful information..
PCB Design Training Institute in Chennai | PCB Designing Training Center in Velachery | Online PCB Design Courses in Chennai | PCB Courses in Velachery
Good Post!!... Thank you so much for sharing your pretty article...
Embedded System Training Institutes in Chennai | Embedded Training Center in Velachery | Embedded Training in Chennai | Embedded System Training in Velachery | Online Embedded Courses in Velachery
Excellent article. blog which you shared is very interesting and helpful.
IELTS Exam Center in Chennai | IELTS Exam Center in Velachery | IELTS Exam Center in Medavakkam | IELTS Exam Center in perungudi | IELTS Exam Center in Tharamani | IELTS Exam Center in pallikarani
Great post...Thanks for your valuable post
CCNP Training Institute in Chennai | CCNP Training Institute in Perungudi | CCNP Training Institute in Tharamani | CCNP Training Institute in Medavakkam
Wonderful Article. Thank you for updating such an informative content.
Linux Training in chennai |
Dot Net Training in chennai |
AWS Training in chennai|
Certified Ethical Hacking Training in Chennai|
Hardware and Networking Training in chennai |
Python Training in chennai|
Web Designing Training Center in chennai
The Information that is shared is very nice and interesting.
Linux Training Institute in Chennai | Linux Training Institute in Tharamani | Linux Training Institute in Medavakkam | Linux Training Institute in Velachery
Excellent information. Thanks for Your great information
AWS Training Institute in Chennai | AWS Training Institute in velachery | AWS Training Institute in Medavakkam | AWS
Training Institute in Tharamani | AWS Training Institute in Perungudi
Your content is very unique and understandable useful for the readers keep update more article like this.
Hardware and Networking Training Institute In Chennai. |
Hardware and Networking Training Institute In velachery. |
Hardware and Networking Training Institute In medavakkam |
Hardware and Networking Training Institute Pallikaranai. |
Hardware and Networking Training Institute In Tharamani. |
Hardware and Networking Training Institute In Thiruvanmiyur. |
Hardware and Networking Training Institute In perungudi. |
Hardware and Networking Training Institute In Thambaram..
Interesting blog....
PMP Exam Center in Chennai | PMP Exam Center in Velachery | PMP Exam Center in Medavakkam | PMP Exam Center in Perungudi
I have read your blog, its really very attractive and impressive. I like your content. Thanks for sharing such an amazing information with us...
CCNA Training Institute In Chennai. |
CCNA Training Institute In velachery. |
CCNA Training Institute In medavakkam |
CCNA Training Institute Pallikaranai. |
CCNATraining Institute In Tharamani. |
CCNA Training Institute In Thiruvanmiyur. |
CCNA Training Institute In perungudi. |
CCNA Training Institute In Thambaram..
Nice post. It was really effective. Thank you for sharing.
AWS Training in Chennai & velachery|
Certified Ethical Hacking Training in Chennai & velachery|
Linux Training in Chennai & velachery |
Hardware and Networking Training in Chennai & velachery |
JAVA Training in Chennai & velachery |
Python Training in Chennai & velachery |
Dot Net Training in Chennai & velachery |
Web Designing Training Center in Chennai & velachery |
Amazing Information my sincere thanks for sharing this post Please Continue to share this kind of blog..
Final Year Project Center in Chennai | Final Year Projects in Velachery | Final Year IEEE Projects in Velachery | Online Project Center in Chennai | BE Projects in Chennai | ME Projects in Velachery
Nice blog. I feel really happy to have seen your webpage and look forward to so many more entertaining times reading here. Thanks once more for all the details.
JAVA Training in Chennai & velachery |
Python Training in Chennai & velachery |
AWS Training in Chennai & velachery|
Certified Ethical Hacking Training in Chennai & velachery|
Linux Training in Chennai & velachery |
Hardware and Networking Training in Chennai & velachery |
Dot Net Training in Chennai & velachery |
Web Designing Training Center in Chennai & velachery |
very interesting article...
Embedded system Training Institute in Chennai | Embedded system Training Institute in Chennai | Embedded system Training Institute in Medavakkam | Embedded system Training Institute in perungudi | Embedded system Training Institute in Velachery
Pretty article! I found some useful information in your blog, it was awesome to read, thanks for sharing this great content to my vision, keep sharing.
AWS Training in Chennai & velachery|
Certified Ethical Hacking Training in Chennai & velachery|
Linux Training in Chennai & velachery |
Hardware and Networking Training in Chennai & velachery |
Dot Net Training in Chennai & velachery |
Web Designing Training Center in Chennai & velachery |
JAVA Training in Chennai & velachery |
Python Training in Chennai & velachery |
I have read your blog it's very interesting...Thank you for Sharing..
JAVA Training in Chennai & velachery |
Python Training in Chennai & velachery |
AWS Training in Chennai & velachery|
Certified Ethical Hacking Training in Chennai & velachery|
Linux Training in Chennai & velachery |
Hardware and Networking Training in Chennai & velachery |
Dot Net Training in Chennai & velachery |
Web Designing Training Center in Chennai & velachery |
Really it was an awesome article...very interesting to read. You have provided an nice article....Thanks for sharing..
MBA Project Center in Chennai | MBA Projects in Velachery
Really nice blog.. Thanks for posting this interesting article with us
AWS Certification in Chennai | AWS Exam Center in Velachery
This post is very simple to read and appreciate without leaving any details out. Great work!
data scientist course aurangabad
Mua vé tại Aivivu, tham khảo
kinh nghiệm mua vé máy bay đi Mỹ giá rẻ
có vé máy bay từ mỹ về việt nam không
thông tin chuyến bay từ canada về việt nam
các chuyến bay từ nhật về việt nam
giá vé máy bay hàn quốc về việt nam
Vé máy bay từ Đài Loan về Việt Nam
khách sạn cách ly hồ chí minh
chuyen bay chuyen gia
Thank you so much for such valuable information sharing. It’s highly appreciated
Agile Scrum Master Training in Chennai | Agile Scrum Master Training in Velachery
Excellent information with unique content and it is very useful to know about the information based on blogs...
Advanced & Core JAVA Training in Velachery |
Python Training in Velachery|
AWS Training in Velachery|
Certified Ethical Hacking Training in Velachery|
Linux Training in Velachery |
Hardware and Networking Training in Velachery |
Dot Net Training in Velachery |
Web Designing Training Center in Velachery |
Impressive blog with lovely information. Really very useful article for us thanks for sharing such a wonderful blog...
Advanced & Core JAVA Training in Chennai |
Python Training in Chennai|
AWS Training in Chennai|
Certified Ethical Hacking Training in Velachery|
Linux Training in Chennai |
Hardware and Networking Training in Chennai |
Dot Net Training in Chennai |
Web Designing Training Center in Chennai |
Nice Post. Thanks for sharing. Keep on updating.
Certified Ethical Hacking Training in Chennai & Velachery|
Linux Training in Chennai & Velachery |
Advanced & Core JAVA Training in Chennai & Velachery |
Python Training in Chennai & Velachery|
Hardware and Networking Training in Chennai & Velachery |
Dot Net Training in Chennai & Velachery |
Web Designing Training Center in Chennai & Velachery |
AWS Training in Chennai & Velachery|
Thank you so much for sharing your nice post with us.. keep updating..
GMAT Test Center in Chennai | GMAT Test Center in Velachery
Nice post. It was really effective. Thank you for sharing.
Certified Ethical Hacking Training in Velachery|
Linux Training in Velachery |
Advanced & Core JAVA Training in Velachery |
Python Training in Velachery|
Hardware and Networking Training in Velachery |
Dot Net Training in Velachery |
Web Designing Training Center in Velachery |
AWS Training in Velachery|
Thank you so much for sharing this worth able content with us. The Niche taken here will be useful for my future programs and I will surely implement them in my study.
Hardware and Networking Training in Chennai and Velachery |
Dot Net Training in Chennai and Velachery |
Web Designing Training Center in Chennai and Velachery |
Certified Ethical Hacking Training in Chennai and Velachery|
Linux Training in Chennai and Velachery |
Advanced & Core JAVA Training in Chennai and Velachery |
Python Training in Chennai and Velachery|
PMP Preparatory Training in Chennai | PMP Preparatory Training in Velachery
Thank you so much for sharing this worth able content with us. Keep blogging article like this.
Advanced & Core JAVA Training in Velachery |
Python Training in Velachery|
Hardware and Networking Training in Velachery |
Dot Net Training in Velachery |
Web Designing Training Center in Velachery |
Certified Ethical Hacking Training in Velachery|
Linux Training in Velachery |
AWS Training in Velachery|
Good Post! Thank you so much for sharing this Awesome post, it was so good to read and useful to improve my knowledge as updated one, keep blogging…
Linux Training in Chennai and Velachery |
AWS Training in Chennai and Velachery|
Advanced & Core JAVA Training in Chennai and Velachery |
Python Training in Chennai and Velachery|
Hardware and Networking Training in Chennai and Velachery |
Dot Net Training in Chennai and Velachery |
Web Designing Training Center in Chennai and Velachery |
Certified Ethical Hacking Training in Chennai and Velachery|
Nice blog. Thank you for sharing. The information you shared is very effective article..
Final Year Project Center in Chennai | Final Year Projects in Velachery
Interesting post. This is really helpful for me as a career Growth. Thanks for sharing……
Certified Ethical Hacking Training in Guindy|
Linux Training in Guindy |
AWS Training in Guindy|
Advanced & Core JAVA Training in Guindy |
Python Training in Guindy|
Hardware and Networking Training in Guindy |
Dot Net Training in Guindy |
Web Designing Training Center in Guindy |
Wow!!... Superb blog with wonderful information..
PCB Design Training Institute in Chennai | PCB Design Training Center in Velachery
very excellent blog . . .
AWS Training Institute in Chennai | CCNA Training Institute in Chennai | Linux Training Institute in Chennai | CCNA Training Institute in Velachery
Excellent information with Best content and it is very useful to know about the information based on blogs...
Certified Ethical Hacking Training in Velachery|
Linux Training in Velachery |
AWS Training in Velachery|
Advanced & Core JAVA Training in Velachery |
Python Training in Velachery|
Hardware and Networking Training in Velachery |
Dot Net Training in Velachery |
Web Designing Training Center in Velachery |
Good information you shared. keep posting.
artificial intelligence courses in chennai
"Thank you very much for your information.
From,
"
ai training in chennai
Very Informative blog thank you for sharing. Keep sharing.
Best software training institute in Chennai. Make your career development the best by learning software courses.
Docker Training in Chennai
blue prism training in chennai
devops training in chennai
The best C & C++ Training in Chennai provides 100% real-time, practical, and placement-focused C & C++ training in Chennai. Our C & C++ course concentrates on rudimentary to advanced-level training. Our squad of C and C++ trainers is C & C++ certified specialists with more actual experience in live projects. Our C and C++ Course program is sufficient for anyone who wants to get C & C++ certification that encounters industry expectations. In our course plan, you will study the Introduction to C and C++, Data Types and Variables, Input Output Management, Modular Programming with Functions, Arrays, Pointers, and Strings, Structures, File Input/Output, Storage Classes, Workday and End of week Classes, Online and Offline Classes, and opportunity homeroom, Experienced Trainers and Lab Facility, Pointers, C++ classes, Inheritance with practical exercises and live specimens.
Your blog is informative and engaging, and it effectively conveys the value of cloud-based analytics using the Azure platform. Keep up the great work!
The Ultimate Data Analytics Training Course- Hands-On Learning and Real-World Applications
Really a awesome blog for the freshers. Thanks for posting the information. Discover the world's best GCSE home tuition with Ziyyara Edutech! Our dedicated GCSE online tuition is designed to empower students with exceptional educational support.
For more info visit GCSE home tuition
Post a Comment