From d5fe6de263640171dde0cdb9f10b02eb94b58ef3 Mon Sep 17 00:00:00 2001 From: SarahAlidoost Date: Fri, 10 Feb 2023 11:03:50 +0100 Subject: [PATCH 1/8] first draft of survey questions --- User Engagement Lead/survey_questions.md | 84 ++++++++++++++++++++++++ 1 file changed, 84 insertions(+) create mode 100644 User Engagement Lead/survey_questions.md diff --git a/User Engagement Lead/survey_questions.md b/User Engagement Lead/survey_questions.md new file mode 100644 index 0000000..1759e11 --- /dev/null +++ b/User Engagement Lead/survey_questions.md @@ -0,0 +1,84 @@ +# Survey questions + +## Readme + +This survey aims at evaluating users’ experiences with ESMValTool and +discovering users’ needs. It is meant for the users of ESMValTool in all levels +of expertise. Some criteria to design the questions: + +- It does not take more than 10 (?) minutes + +- It does not have overlapping questions + +- It does not include questions with yes/no answers + +- It does not collect personal data, but it has some profiling questions + +- It covers different aspects of ESMValTool like application, usage, documentation and community + +The survey can be implemented in a survey app like surveymonkey that does not +collect personal data. The owner is “user engagement team”. They will +edit/run/evaluate the survey and communicate the results to other teams if +needed. + +## Survey content + +Hi! We in [ESMValGroup](https://www.esmvaltool.org/), would love to hear about +your research and experiences using ESMValTool. Here, there are a few questions +which help to create your story. Your answers will help us to improve ESMValTool +and hence enhance the science that you conduct. All responses are recorded +anonymously. Let’s being: + +**Describe your research/case study and challenges:** + +1. Can you describe your research/case study? +2. Can you underline the challenges in your research/case study? +3. How would you categorize your expertise level in using ESMValTool? (Beginner, + competent practitioner, expert) + +**Software:** + +ESMValTool provides many features and functions to analyze data for Earth system +models. +[Here](https://docs.esmvaltool.org/projects/esmvalcore/en/latest/recipe/preprocessor.html#preprocessor) +you can find a list of preprocessors. + +4. Which features/functions in ESMValTool do you think are most useful for your +research/case study? +5. How satisfied are you with the software's: + - Ease of use (1-10) + - Development workflow (1-10) + - Reliability (1-10) + +**Documentation and tutorial:** + +ESMValTool [documentation](https://docs.esmvaltool.org/en/latest/) covers +different aspects of research: How the code work, how to obtain and process +data, and what are best practices in developing code. There is also an online +[tutorial](https://esmvalgroup.github.io/ESMValTool_Tutorial/) that shows not +only how to run an experiment but also how to develop your own code. +If you are familiar with documentation and tutorial, please tell us: + +6. What are the most useful parts? +7. What topics are missing that you want to learn about? +8. How much do you agree with the following statements? + - It is easy to find relevant information from the documentation. (1-10) + - The instructions in the documentation and tutorial are complete and easy + to follow. (1-10) + - I can immediately apply what I learned from the tutorial. (1-10) + +**Community:** + +ESMValTool provides [different +platforms](https://docs.esmvaltool.org/en/latest/introduction.html#support) to +communicate with users and researchers: mailing list, github issues, discussion +page. + +9. If you have used any of these, please tell us how much do you agree with +the following statements? + - I felt comfortable asking my questions using these platforms. (1-10) + - I was able to get clear answers to my questions from the community. (1-10) +10. What suggestions do you have for improvements, or any other relevant input for us? + + +Thank you for helping us to build the ESMValTool that you like. \ No newline at end of file From 321ce2e9ea24a1489bdb65413495a9afb85ae669 Mon Sep 17 00:00:00 2001 From: SarahAlidoost Date: Fri, 10 Feb 2023 11:05:12 +0100 Subject: [PATCH 2/8] minor edit --- User Engagement Lead/survey_questions.md | 4 ---- 1 file changed, 4 deletions(-) diff --git a/User Engagement Lead/survey_questions.md b/User Engagement Lead/survey_questions.md index 1759e11..abd4eef 100644 --- a/User Engagement Lead/survey_questions.md +++ b/User Engagement Lead/survey_questions.md @@ -7,13 +7,9 @@ discovering users’ needs. It is meant for the users of ESMValTool in all leve of expertise. Some criteria to design the questions: - It does not take more than 10 (?) minutes - - It does not have overlapping questions - - It does not include questions with yes/no answers - - It does not collect personal data, but it has some profiling questions - - It covers different aspects of ESMValTool like application, usage, documentation and community The survey can be implemented in a survey app like surveymonkey that does not From 862448dd4ce96e73c0c75532d510ca20ae1931e6 Mon Sep 17 00:00:00 2001 From: SarahAlidoost <55081872+SarahAlidoost@users.noreply.github.com> Date: Mon, 3 Apr 2023 14:14:38 +0200 Subject: [PATCH 3/8] fix typo MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Co-authored-by: Rémi Kazeroni --- User Engagement Lead/survey_questions.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/User Engagement Lead/survey_questions.md b/User Engagement Lead/survey_questions.md index abd4eef..cea85ae 100644 --- a/User Engagement Lead/survey_questions.md +++ b/User Engagement Lead/survey_questions.md @@ -23,7 +23,7 @@ Hi! We in [ESMValGroup](https://www.esmvaltool.org/), would love to hear about your research and experiences using ESMValTool. Here, there are a few questions which help to create your story. Your answers will help us to improve ESMValTool and hence enhance the science that you conduct. All responses are recorded -anonymously. Let’s being: +anonymously. Let’s begin: **Describe your research/case study and challenges:** From 27032992423c00e89c70a8b9dc278f68a7fb9729 Mon Sep 17 00:00:00 2001 From: SarahAlidoost <55081872+SarahAlidoost@users.noreply.github.com> Date: Mon, 3 Apr 2023 15:52:32 +0200 Subject: [PATCH 4/8] add recipes link --- User Engagement Lead/survey_questions.md | 11 +++++------ 1 file changed, 5 insertions(+), 6 deletions(-) diff --git a/User Engagement Lead/survey_questions.md b/User Engagement Lead/survey_questions.md index cea85ae..966e47a 100644 --- a/User Engagement Lead/survey_questions.md +++ b/User Engagement Lead/survey_questions.md @@ -34,12 +34,11 @@ anonymously. Let’s begin: **Software:** -ESMValTool provides many features and functions to analyze data for Earth system -models. -[Here](https://docs.esmvaltool.org/projects/esmvalcore/en/latest/recipe/preprocessor.html#preprocessor) -you can find a list of preprocessors. +ESMValTool provides many recipes (scientific workflows), features and functions to analyze data for Earth system +models. See the [list of preprocessors](https://docs.esmvaltool.org/projects/esmvalcore/en/latest/recipe/preprocessor.html#preprocessor) +and [list of recipes](https://docs.esmvaltool.org/en/latest/recipes/index.html). -4. Which features/functions in ESMValTool do you think are most useful for your +4. Which recipes/preprocessors in ESMValTool do you think are most useful for your research/case study? 5. How satisfied are you with the software's: - Ease of use (1-10) @@ -77,4 +76,4 @@ the following statements? 10. What suggestions do you have for improvements, or any other relevant input for us? -Thank you for helping us to build the ESMValTool that you like. \ No newline at end of file +Thank you for helping us to build the ESMValTool that you like. From 237ac030f6f52100bf15b74d11dc47f423738e48 Mon Sep 17 00:00:00 2001 From: SarahAlidoost Date: Fri, 23 Jun 2023 13:32:33 +0200 Subject: [PATCH 5/8] add a question about platforms, move suggestions to next section (Birgit suggestions) --- User Engagement Lead/survey_questions.md | 16 +++++++++++++--- 1 file changed, 13 insertions(+), 3 deletions(-) diff --git a/User Engagement Lead/survey_questions.md b/User Engagement Lead/survey_questions.md index 966e47a..ad821c2 100644 --- a/User Engagement Lead/survey_questions.md +++ b/User Engagement Lead/survey_questions.md @@ -35,7 +35,7 @@ anonymously. Let’s begin: **Software:** ESMValTool provides many recipes (scientific workflows), features and functions to analyze data for Earth system -models. See the [list of preprocessors](https://docs.esmvaltool.org/projects/esmvalcore/en/latest/recipe/preprocessor.html#preprocessor) +models. See the [list of preprocessors](https://docs.esmvaltool.org/projects/esmvalcore/en/latest/recipe/preprocessor.html#preprocessor) and [list of recipes](https://docs.esmvaltool.org/en/latest/recipes/index.html). 4. Which recipes/preprocessors in ESMValTool do you think are most useful for your @@ -69,11 +69,21 @@ platforms](https://docs.esmvaltool.org/en/latest/introduction.html#support) to communicate with users and researchers: mailing list, github issues, discussion page. -9. If you have used any of these, please tell us how much do you agree with +9. Which platform are you familiar with: (multiple questions) + + - [User mailing list](https://docs.esmvaltool.org/en/latest/introduction.html#user-mailing-list) + - GitHub issues + - Discussion page + - ESMValTool Website https://esmvaltool.org/ + - Twitter https://twitter.com/esmvaltool + +10. If you have used any of these, please tell us how much do you agree with the following statements? - I felt comfortable asking my questions using these platforms. (1-10) - I was able to get clear answers to my questions from the community. (1-10) -10. What suggestions do you have for improvements, or any other relevant input for us? +**Other** + +What suggestions do you have for improvements, or any other relevant input for us? Thank you for helping us to build the ESMValTool that you like. From e6485718e65da9e9d4cd7a5207e8f6431b26245d Mon Sep 17 00:00:00 2001 From: SarahAlidoost Date: Fri, 23 Jun 2023 13:38:37 +0200 Subject: [PATCH 6/8] update section Describe your reaserch (Birgit and Ranjini suggestions), fix typo --- User Engagement Lead/survey_questions.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/User Engagement Lead/survey_questions.md b/User Engagement Lead/survey_questions.md index ad821c2..d1dc122 100644 --- a/User Engagement Lead/survey_questions.md +++ b/User Engagement Lead/survey_questions.md @@ -27,8 +27,8 @@ anonymously. Let’s begin: **Describe your research/case study and challenges:** -1. Can you describe your research/case study? -2. Can you underline the challenges in your research/case study? +1. Can you describe your research/case study with respect to data processing? +2. Can you underline the challenges in your research/case study with respect data handling? 3. How would you categorize your expertise level in using ESMValTool? (Beginner, competent practitioner, expert) @@ -48,7 +48,7 @@ research/case study? **Documentation and tutorial:** ESMValTool [documentation](https://docs.esmvaltool.org/en/latest/) covers -different aspects of research: How the code work, how to obtain and process +different aspects of research: How the code works, how to obtain and process data, and what are best practices in developing code. There is also an online [tutorial](https://esmvalgroup.github.io/ESMValTool_Tutorial/) that shows not only how to run an experiment but also how to develop your own code. From 09146eb72800891c4f81c62b30207056b34567b4 Mon Sep 17 00:00:00 2001 From: SarahAlidoost Date: Fri, 23 Jun 2023 13:43:14 +0200 Subject: [PATCH 7/8] separate documentation from tutorial (Lisa suggestions) --- User Engagement Lead/survey_questions.md | 27 +++++++++++++++++------- 1 file changed, 19 insertions(+), 8 deletions(-) diff --git a/User Engagement Lead/survey_questions.md b/User Engagement Lead/survey_questions.md index d1dc122..ce41ea9 100644 --- a/User Engagement Lead/survey_questions.md +++ b/User Engagement Lead/survey_questions.md @@ -45,20 +45,31 @@ research/case study? - Development workflow (1-10) - Reliability (1-10) -**Documentation and tutorial:** +**Documentation:** ESMValTool [documentation](https://docs.esmvaltool.org/en/latest/) covers different aspects of research: How the code works, how to obtain and process -data, and what are best practices in developing code. There is also an online -[tutorial](https://esmvalgroup.github.io/ESMValTool_Tutorial/) that shows not -only how to run an experiment but also how to develop your own code. -If you are familiar with documentation and tutorial, please tell us: +data, and what are best practices in developing code.If you are familiar with +the documentation, please tell us: 6. What are the most useful parts? 7. What topics are missing that you want to learn about? 8. How much do you agree with the following statements? - It is easy to find relevant information from the documentation. (1-10) - - The instructions in the documentation and tutorial are complete and easy + - The instructions in the documentation are complete and easy + to follow. (1-10) + +**Tutorial:** + +There is also an online +[tutorial](https://esmvalgroup.github.io/ESMValTool_Tutorial/) that shows not +only how to run an experiment but also how to develop your own code. If you are +familiar with the tutorial, please tell us: + +9. What are the most useful lessons? +10. What topics are missing that you want to learn about? +11. How much do you agree with the following statements? + - The instructions in the tutorial are complete and easy to follow. (1-10) - I can immediately apply what I learned from the tutorial. (1-10) @@ -69,7 +80,7 @@ platforms](https://docs.esmvaltool.org/en/latest/introduction.html#support) to communicate with users and researchers: mailing list, github issues, discussion page. -9. Which platform are you familiar with: (multiple questions) +12. Which platform are you familiar with: (multiple questions) - [User mailing list](https://docs.esmvaltool.org/en/latest/introduction.html#user-mailing-list) - GitHub issues @@ -77,7 +88,7 @@ page. - ESMValTool Website https://esmvaltool.org/ - Twitter https://twitter.com/esmvaltool -10. If you have used any of these, please tell us how much do you agree with +13. If you have used any of these, please tell us how much do you agree with the following statements? - I felt comfortable asking my questions using these platforms. (1-10) - I was able to get clear answers to my questions from the community. (1-10) From 6dc3a759386860094ef90c338bca01a5d4d9e316 Mon Sep 17 00:00:00 2001 From: SarahAlidoost Date: Fri, 23 Jun 2023 13:50:30 +0200 Subject: [PATCH 8/8] apply some suggestions by Ranjini --- User Engagement Lead/survey_questions.md | 15 +++++++-------- 1 file changed, 7 insertions(+), 8 deletions(-) diff --git a/User Engagement Lead/survey_questions.md b/User Engagement Lead/survey_questions.md index ce41ea9..671ba4d 100644 --- a/User Engagement Lead/survey_questions.md +++ b/User Engagement Lead/survey_questions.md @@ -20,10 +20,9 @@ needed. ## Survey content Hi! We in [ESMValGroup](https://www.esmvaltool.org/), would love to hear about -your research and experiences using ESMValTool. Here, there are a few questions -which help to create your story. Your answers will help us to improve ESMValTool -and hence enhance the science that you conduct. All responses are recorded -anonymously. Let’s begin: +your research and experiences using ESMValTool. Your answers will help us to +improve ESMValTool and hence enhance the science that you conduct. All responses +are recorded anonymously. **Describe your research/case study and challenges:** @@ -38,7 +37,7 @@ ESMValTool provides many recipes (scientific workflows), features and functions models. See the [list of preprocessors](https://docs.esmvaltool.org/projects/esmvalcore/en/latest/recipe/preprocessor.html#preprocessor) and [list of recipes](https://docs.esmvaltool.org/en/latest/recipes/index.html). -4. Which recipes/preprocessors in ESMValTool do you think are most useful for your +4. Which recipes/preprocessors in ESMValTool have you found to be most useful for your research/case study? 5. How satisfied are you with the software's: - Ease of use (1-10) @@ -52,7 +51,7 @@ different aspects of research: How the code works, how to obtain and process data, and what are best practices in developing code.If you are familiar with the documentation, please tell us: -6. What are the most useful parts? +6. What aspects or specific sections if any did you find most useful in the documentation? 7. What topics are missing that you want to learn about? 8. How much do you agree with the following statements? - It is easy to find relevant information from the documentation. (1-10) @@ -66,7 +65,7 @@ There is also an online only how to run an experiment but also how to develop your own code. If you are familiar with the tutorial, please tell us: -9. What are the most useful lessons? +9. What aspects or specific sections if any did you find most useful in the tutorial? 10. What topics are missing that you want to learn about? 11. How much do you agree with the following statements? - The instructions in the tutorial are complete and easy @@ -88,7 +87,7 @@ page. - ESMValTool Website https://esmvaltool.org/ - Twitter https://twitter.com/esmvaltool -13. If you have used any of these, please tell us how much do you agree with +13. If you have used any of these, please tell us how much you agree with the following statements? - I felt comfortable asking my questions using these platforms. (1-10) - I was able to get clear answers to my questions from the community. (1-10)