{"id":15680,"date":"2021-06-28T13:00:00","date_gmt":"2021-06-28T20:00:00","guid":{"rendered":"https:\/\/devwww.3cloudsolutions.com\/post\/techniques-to-make-your-survey-data-sing-3\/"},"modified":"2024-06-18T09:13:12","modified_gmt":"2024-06-18T16:13:12","slug":"techniques-to-make-your-survey-data-sing","status":"publish","type":"post","link":"https:\/\/3cloudsolutions.com\/resources\/techniques-to-make-your-survey-data-sing\/","title":{"rendered":"Techniques to Make your Survey Data Sing"},"content":{"rendered":"<p>With the ubiquity of online survey services like <span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"https:\/\/www.surveymonkey.com\/\">SurveyMonkey<\/a><\/span>, <a href=\"https:\/\/www.qualtrics.com\/\"><span style=\"color: #007cba;\">Qualtrics<\/span><\/a>, and many others, it\u2019s very simple today to get a survey out to a large group of people and collect responses in a timely manner. The question is, what can you do with all that data that comes back to get the most value out of it? Recently, I did some volunteer work for a local government agency to produce visualizations for print, using <span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"https:\/\/www.bluegranite.com\/modern-bi\">Power BI<\/a><\/span>, and I want to share some techniques that worked well. If you are an advanced Excel user, and perhaps are wondering what benefit there is in newer tools like Power BI and Power Query, this post is for you.<\/p>\n<p><!--more--><\/p>\n<p><span style=\"color: #007cba;\"><img decoding=\"async\" style=\"width: 1000px;\" src=\"https:\/\/3cloudsolutions.com\/wp-content\/uploads\/2022\/12\/Blog_Singing-Survey-Results-1.png\" alt=\"Blog_Singing Survey Results\" width=\"1000\" \/><br \/>\n<\/span><\/p>\n<h2><span style=\"color: #007cba;\">Problem<\/span><\/h2>\n<p>Traditional survey results from services can be a bit lackluster because the services are general-purpose, and they don\u2019t \u201cknow\u201d your data intimately. The appearance of charts and graphs or typeface and color selections may be limited and, most important, getting deeper insights into your results may require extra steps and extra time. This is especially true of doing analysis of the data <em>across<\/em> different questions.<\/p>\n<h2><\/h2>\n<h2><span style=\"color: #007cba;\">Suggestions<\/span><\/h2>\n<h3><span style=\"color: #007cba;\"><span style=\"color: #000000;\">Get the Data<br \/>\n<\/span><\/span><\/h3>\n<p>The first step is to pull the results out of the service in a basic, raw data format such as an Excel spreadsheet or CSV file. Examine what you\u2019re getting back in terms of format \u2013 what are the columns? How are different types of questions represented? Are they text, numerical values? For a given question, are the responses spread across different columns?<\/p>\n<p style=\"vertical-align: bottom;\"><span style=\"color: black;\"><img decoding=\"async\" style=\"width: 1000px;\" src=\"https:\/\/3cloudsolutions.com\/wp-content\/uploads\/2022\/11\/image-png-Jun-25-2021-04-48-53-52-PM.png\" width=\"1000\" \/><\/span><\/p>\n<p>We aren\u2019t going to look at survey design issues in this post, focusing on how to consume the data. But one basic technique is to ask some demographics questions in addition to questions about the topic at hand. For each survey question, make a note of which category it belongs in \u2013 is it about the respondent? Or about the topic? The demographics answers are data we want to transform into dimensions &#8211; that is, data that describe all the other questions.<\/p>\n<p>Another way to think about this is the \u201cby\u201d phrase \u2013 what are the questions in your survey that you want to see \u201cby\u201d other responses? For example, is it favorite color <em>by age group?<\/em> Whatever is after the \u201cby\u201d is the dimension you will want to apply <em>across<\/em> all the topic-related questions.<\/p>\n<p>Next, examine the questions by question type. Setting aside the topic content altogether, note which questions are numeric or text responses, which are multiple choice, which are ranking and so on. It\u2019s likely that you\u2019ll end up processing the data in the same way for questions of the same type.<\/p>\n<h3><span style=\"color: #000000;\">\u00a0<\/span><\/h3>\n<h3><span style=\"color: #007cba;\"><span style=\"color: #000000;\">Structure the Data<\/span><\/span><\/h3>\n<p>To make a professional-quality analysis often requires reshaping the data. The specific task we had with this survey was a one-time effort with the goal of producing a document, so for ease of use we used <a href=\"https:\/\/docs.microsoft.com\/en-us\/power-query\/power-query-what-is-power-query\">Power Query<\/a> and Tables in Excel to shape the data, and Power BI to create print visuals. If you face something larger, repeated, or more complex, it may be worth considering a <a href=\"https:\/\/www.bluegranite.com\/modern-data-platform\">more robust database solution<\/a> than Excel.<\/p>\n<p>Power Query\u2019s great advantage is that it makes a repeatable data transformation that can be refined and re-run, as opposed to a manual manipulation of the data that is difficult to repeat.<\/p>\n<p>These are some types of transformations to consider for surveys in particular:<\/p>\n<ul>\n<li style=\"vertical-align: bottom;\">Take those questions that are in your \u201cdimensions\u201d category \u2013 the \u201cby\u201d questions \u2013 and make a small, numbered table of the possible responses. This can be done quickly by copying all the responses from a column, pasting into a new sheet, and using Data &gt; Remove Duplicates.\n<p><img decoding=\"async\" style=\"margin: 0px;\" src=\"https:\/\/3cloudsolutions.com\/wp-content\/uploads\/2022\/11\/image-png-Jun-25-2021-04-51-03-31-PM.png\" \/><\/li>\n<li>Use Power Query\u2019s <span style=\"text-decoration: none;\"><span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"https:\/\/support.microsoft.com\/en-us\/office\/merge-queries-power-query-fd157620-5470-4c0f-b132-7ca2616d17f9\" target=\"_blank\" rel=\"noopener\">Merge<\/a><\/span><\/span> to bring the numbered column back into your data, by joining on the text. In our case, I used the raw data in one table as a source and output a second table of results containing the Power Query transformation(s).\n<p>Listing these values separately gives you these major advantages: The values will be represented as a named table; you can very easily create alternate\/shorter labels to the literal responses from the survey; it\u2019s very simple to provide a custom sort order for your results that is not the alphabetical order of the text, which is a very common requirement for graphs; and you can very easily create groupings or rollups just by adding a column of categories.<\/li>\n<li>Do the same thing to explicitly number and label your questions. This might seem odd, but in some survey service results, while the answers are all present in columns of data, the specific question numbers and text are not.\n<p><img decoding=\"async\" src=\"https:\/\/3cloudsolutions.com\/wp-content\/uploads\/2022\/11\/image-png-Jun-25-2021-04-52-32-84-PM.png\" \/><\/li>\n<\/ul>\n<h3><span style=\"color: #007cba;\"><span style=\"color: #000000;\">Produce Print Visuals<br \/>\n<\/span><\/span><\/h3>\n<div>\n<p>Once we had the <a href=\"https:\/\/www.bluegranite.com\/blog\/better-together-blog-series-emphasizing-data-engineering\">cleaned and transformed data<\/a> set in tables, we used that as the source for Power BI Desktop, making a small <a href=\"https:\/\/www.bluegranite.com\/blog\/dimensional-modeling-in-the-advanced-analytics-age\">data model<\/a>:<\/p>\n<\/div>\n<p><img decoding=\"async\" style=\"width: 1000px;\" src=\"https:\/\/3cloudsolutions.com\/wp-content\/uploads\/2022\/11\/image-png-Jun-25-2021-04-55-32-32-PM.png\" width=\"1000\" \/><\/p>\n<p>This creates a <a href=\"https:\/\/docs.microsoft.com\/en-us\/power-bi\/guidance\/star-schema\">Star Schema<\/a>, where each box represents a table from Excel. At the center you can see the responses to all the questions, and around the outside are all those \u201cdimension\u201d categories. Each of the smaller tables like Gender or Frequency contains a numbered list of the possible response values for one question. Where we needed a set of custom labels, a custom sort order, or groupings of values, we just quickly added them to that table in Excel, and they would appear here after clicking Refresh.<\/p>\n<p>This underlying structure makes it very simple to make the visuals, including handing that problem of breaking out responses to questions \u201cby\u201d other categories.<\/p>\n<p><img decoding=\"async\" style=\"width: 1000px;\" src=\"https:\/\/3cloudsolutions.com\/wp-content\/uploads\/2022\/11\/image-png-Jun-25-2021-04-56-15-59-PM.png\" width=\"1000\" \/><\/p>\n<p>Through some iteration refining the Power Query scripts and refreshing this Power BI report, we were able to produce 30+ pages of truly in-depth presentation over the data.<\/p>\n<p>Producing the final graphics is as simple as Export &gt; PDF, and the resulting pages can be incorporated into whichever publishing tool you prefer.<\/p>\n<h3><\/h3>\n<h3><span style=\"color: #000000;\">Post-processing the Visuals<br \/>\n<\/span><\/h3>\n<p>Many automated chart and graph tools are wonderful as a baseline for creating visualizations, but they also have some limitations you might run into, where you can\u2019t format a graph just the way you\u2019d like to see it. Perhaps the labels land in the wrong place, or you need some alternate data labels that the tool is not capable of rendering. For these cases, don\u2019t be afraid to post-process the graphics in another tool. The PDF files that come out of Power BI, for example, can be edited as artwork in Adobe Illustrator or another vector drawing tool.<\/p>\n<h2><span style=\"color: #007cba;\">Conclusion<\/span><\/h2>\n<p>By exploring our results using clear visuals on this project, the group involved was able to see if hunches they had about opinions were supported by data. They could explore relationships, such as the opinions of under-represented groups, that might otherwise have been lost in a wall of numbers. Finally, they presented the data to a public \/ non-expert audience in a way that is clear and intuitive.<\/p>\n<p>Please visit our website to learn more, or <a href=\"\/get-started\/\">contact us directly<\/a> to see how we can help you explore your about modern data analytics options and accelerate your business value.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Recently, I did some volunteer work for a local government agency to produce visualizations for print using survey results data, utilizing Power BI and want to share some techniques that worked well. If you are an advanced Excel user, and perhaps are wondering what benefit there is in newer tools like Power BI and Power Query, this post is for you.<\/p>\n","protected":false},"author":21,"featured_media":12601,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","footnotes":""},"categories":[260],"tags":[307,305,316],"class_list":["post-15680","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-ai","tag-digital-transformation","tag-modern-bi","tag-public-sector","topics-blog"],"acf":[],"_links":{"self":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/15680","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/users\/21"}],"replies":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/comments?post=15680"}],"version-history":[{"count":0,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/15680\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media\/12601"}],"wp:attachment":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media?parent=15680"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/categories?post=15680"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/tags?post=15680"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}