Generative AI | Chat GPT Critique • Critical Thinking • Empowerment

Kolesnikov, Veronika

Generative AI: Chat GPT Critique, Critical Thinking, Empowerment

Reflection on Instructional Change:

Throughout the Generative AI training, I learned about the importance of integrating generative AI in my courses and empowering students with the skills to use the tools such as ChatGPT. In the beginning of the semester and throughout I shared with students techniques on using chatgpt as those presented in our training. I really believe in using generative AI as a tool to bridge the divide and promote equity and access to information and learning tools. I created an assignment called Quiz Reflection & Chat GPT Application. The detailed directions of the assignment are posted below. Directions as presented to the students

Quiz Reflection & Chat GPT Application Analysis

About the Quiz Reflection & Chat GPT Application Analysis

There will be 10 quiz reflections & AI Application Analysis total during the course. This assessment is composed of two components; the quiz reflection and AI Application Analysis. The purpose of this assessment is to promote a deeper understanding of the material, reflection of knowledge attained from the quizzes and evaluation of an AI application Analysis. Below are details for both. Before you start working on this assessment, complete the module quiz first.

Quiz Reflection

The purpose of this assessment is to promote a more complex understanding of the material learned by taking the module quiz. First take the module quiz and review the correct and incorrect answers and the correct answer explanations. Afterwards, write a 250 word reflection on what you learned by taking the quiz. As a student, I would study a lot for a quiz/test and then forget the material. In my courses, I design learning strategies so that students can actually take something from the course. This promotes engagement, agency and critical thinking.

Rubric - 10 Points

Write a 250 word reflection. You can also make a video instead of writing it out and submit the link to the video.
Include a reflection on:
- What did you learn from the quiz?
- What was a question/answer that stood out to you and why?
- Is there a question that you would like more information on or a topic that you think can be better addressed in a quiz?

AI Application Analysis

The purpose of this component is to promote analytical and critical thinking. For this component, students use Chat GPT to firstly further build on your reflection & what you have learned, secondly to decipher information from Chat GPT and finally to critique Chat GPT's analysis of the material.

Yes, this is a new form of assessment. Chat GPT can be used as a tool to promote learning, equity and student success. Learning how to use Chat GPT is a skill itself. I will share what I have learned by using this tool. So, let's get to the directions.

Directions

Get the Free Chat GPT app ( if you're not sure where to start, please let me know, I'm here to help)
Then review what you learned from the quiz in the reflection and create a question to ask on the Chat GPT platfrom to build on the knowledge attained.
Enter the question on Chat GPT, take a screenshot or copy/paste both your original question and the Chat GPT answer.
You might go down a rabbit hole of questions/answers and it's a cool/fun exploratory process. (I will share with you my first rabbit whole interchange that I had with Chat GPT. It was very informative)
Analyze the Chat GPT responses based on the material in the book, the quiz, your knowledge & reflection. Find one aspect in the Chat GPT response that can be elaborate on or improved.
State what it is and what Chat GPT missed.

Rubric - 10 points total

Your original question - 2.5 points
The Chat GPT responses - 2.5 points
Your analysis & Critique - 5 points

I look forward to learning from your reflection and analysis!

Reflection of the Usage of the ACUE Technique

In the beginning of the semester, students were shocked that we were going to use chatgpt. There were a lot of negative thoughts about it. I explained to the students that I'm in the Generative AI and I'm learning how to implement generative AI in my courses and how to empower students with tools and resources to use it successfully. They became interested in using it. Throughout the semester I shared techniques with them on how to use chat gpt for example to create a summary of notes, brainstorming and more.

In the beginning of the semester, the majority of students just stated that chatgpt answered everything correctly. I encouraged students to think critically and see what chatgpt was missing. At the end of the semester, I saw an improvement in responses. Students were taking apart the chatgpt responses and finding what it missed, etc. I felt like students learned a lot from this assignment instead of just taking a quiz. I also felt that students felt more empowered in their own agency to understand complex constructs and think critically about them.

At the end of the semester, I asked students to answer some optional questions for me to learn about their experiences with this assignment. This was just done for internal teacher reflection. I have not shared or published it anywhere. I'm in the process of reviewing the data in detail however there were some overarching findings. Students did become more confident in using chat gpt, they saw the benefits of using it. They also warned about some dangers in solely relying on chatgpt. Overall tentatively, the students experience were positive.

ACUE Gen AI Course Activities:
- Empowering Students Using AI: Discussion and Reflection
  - Draft a friendly reminder for your syllabus that encourages students to use GenAI wisely and with integrity.
    1. first entry:
      Friendly Reminder:
      
      Dear Students,
      
      As we delve into the fascinating world of child development this semester, we want to take a moment to remind you about the importance of academic integrity and responsible use of resources, including AI technologies such as GenAI.
      
      While GenAI can be a valuable tool for research and learning, it's essential to use it wisely and ethically. Remember that academic integrity is a cornerstone of our university community, and all work submitted should be your own, properly cited, and based on your own understanding and analysis.
      
      When using GenAI or any other AI technology, ensure that you are using it to enhance your learning experience, rather than as a shortcut or replacement for critical thinking and independent research. Use it to generate ideas, check your understanding, and explore different perspectives, but always make sure to verify the accuracy and credibility of the information it provides.
      
      Additionally, be mindful of the ethical implications of using AI, especially in sensitive areas such as child development. Respect the privacy and dignity of individuals and families whose experiences may be discussed or analyzed.
      
      By approaching GenAI with integrity and responsibility, you not only uphold the standards of academic excellence but also contribute to creating a respectful and ethical learning environment for everyone.
      
      Thank you for your attention to this matter, and we look forward to a semester filled with insightful discussions and meaningful learning experiences.
      
      Best regards,
    2. 2nd entry, asked to summarize/shorten:
      Friendly Reminder:
      
      Dear Students,
      
      As we explore child development this semester, remember to use GenAI responsibly. Academic integrity is crucial, so ensure that all work submitted is your own, properly cited, and based on your understanding.
      
      GenAI can be a helpful tool for research, but use it to enhance your learning, not as a shortcut. Verify information for accuracy and respect privacy when discussing sensitive topics.
      
      Let's uphold academic excellence and create a respectful learning environment together.
      
      Best regards,
  - Think about a class activity that will get students excited about crafting sharp GenAI prompts and critically evaluating their results. -- I started using it for the research midterm. At the beginning of the semester, I had an activity where students started to mold their research question using chatgpt. I do want to do an activity next semester where we ask it to list peer reviewed articles and then guide students to personally review if the articles are peer reviewed.
  - Imagine an assignment where GenAI plays a supporting role in the learning process. Create some talking points that cover how you’d introduce this to students, while reminding them about the responsible use of GenAI.
    1. Instructions I gave chatgpt: create an announcement to students about an assignment where they use chatgpt to create a research hypothesis and then find 5 peer reviewed articles. Remind them to use chatgpt as a tool and with a critical lense as the final evaluator. Encourage students that they have agency, knowledge and wisdom to successfully do the assignment but they can use chatgpt as a tool.
    2. Chatgpt's original response:
      Dear Students,
      
      In our upcoming assignment, you will have the opportunity to utilize ChatGPT as a tool to formulate a research hypothesis. ChatGPT can provide valuable insights and generate ideas, but it is important to approach its use with a critical lens.
      
      Your task is to interact with ChatGPT to develop a research hypothesis related to our course topic. While ChatGPT can offer suggestions, remember that you are the final evaluator of the hypothesis. Your agency, knowledge, and wisdom are essential in shaping the direction of your research.
      
      Once you have formulated your hypothesis, your next step is to find five peer-reviewed articles to support or challenge your hypothesis. Use ChatGPT as a resource to assist you in locating relevant literature, but remember to critically evaluate the credibility and validity of the sources you find.
      
      This assignment is an opportunity for you to demonstrate your critical thinking skills and research abilities. While ChatGPT can be a helpful tool, your own analysis and interpretation are paramount.
      
      I encourage you to approach this assignment with confidence, knowing that you have the skills and knowledge to succeed. Use ChatGPT as a supplement to your own expertise, and you will produce high-quality research.
      
      If you have any questions or need guidance throughout the assignment, don't hesitate to reach out. I am here to support you every step of the way.
      
      Best regards,
- Leveraging AI to Develop Course Resources: Discussion and Reflection
  - Think about an existing course resource that might be enhanced using GenAI. What changes could you make, and how might both you and your students benefit from this enhancement? - During the practice part of this module, I asked chat gpt to create a rubric for an assignment and it did. then I asked it to create it into a table and that was so easy. since then, I have used chatgpt to create rubrics for three of my midterms. I had to give clear directions but it was efficient.
  - Think about a new resource that you could create using GenAI to support student learning. Describe the type of resource and how it could be integrated into your course to improve student engagement and understanding. - I plan to guide students into using chatgpt in creating study guide materials. The books that I use are online and free. so they can copy sections of the book, then give chat gpt directions to create a study guide or bullet points of main topics and submit to chat gpt. I think students can benefit from this not only for my course but others as well.
- Teaching with AI-Inclusive and AI-Resistance Learning Experiences: Discussion and Reflection
  - I'm honestly very bummed that I'm not able to access my reflections on acue. When I did the modules, I wrote super detailed reflections in hope to benefit for my grade but also to revisit them and learn from them. is there any way we can access them? I tried looking at the modules and emails and nothing. I will try to do my best to reflect here.
  - In my next assignment that leverages GenAI, I plan to [specific use or approach], because I believe it will [expected benefit or learning outcome for students]. - I believe that I wrote about an assignment that I created in which students use chat gpt. first they reflect on their quiz, then they make a question to ask chatgpt and then critique it's response. I've seen improvements in critical thinking and agency through this assignment.
  - To create an AI-resistant assignment, I intend to [describe the strategy or approach], ensuring that it challenges students to [desired learning objective or skill development]. integrate research and teaching practices so that students are challenged yet receive the assistance they need to succeed. I wish I had access to my reflection file.
  - One challenge I anticipate in balancing AI-inclusive and AI-resistant assignments is [describe challenge], and a potential solution I’m considering is [describe solution]. teaching students about the benefits of chatgpt and that it can be used as a tool so that students are empowered to do their best but also not use it as a crutch.
- Writing Effective Prompts: Discussion and Reflection
  - Reflect on your learning journey and identify three key discoveries you made about creating effective GenAI prompts. What new insights or techniques really clicked for you? What if any of this content confirmed something you already knew?
    1. using it to create/improve/clarify rubrics
    2. use it to create feedback for assignments
    3. use it to make announcements
  - Now, think about the practical side. Describe two ways you plan to apply these GenAI prompt strategies to enhance your course announcements or other communications. How will these techniques make your work more efficient, engaging, or effective?
    1. I have already started using chatgpt in my instruction. Once a week, they complete a quiz, then quiz reflection, then create a question to ask chatgpt to enhance their learning and then critique chatgpt responses. in the beginning of the semester, the students were just saying chatgpt is great but now they are really thinking critically about it. So, I want to continue to use it but enhance it. i should ask chatgpt to review my assignment and give me feedback.
    2. I started using it for announcements and creating feedback. Everytime, I think I'm improving my skills in guiding chatgpt.
  - Finally, pinpoint one question or area you’re still curious about regarding how to utilize GenAI in crafting course communications. Remember, curiosity fuels growth and learning! -- ohhh, I feel like I had a really important question that I wrote here, oh I think it was how to get the plug in so that chat gpt can go to the links/references of papers and see if they are peer reviewed.
CTL "Observe and Analyze" synchronous zoom session with your colleagues

I had a few aha moments in the observe and analyze session. I had originally asked participants to give feedback on how I can simplify this assignment and integrate it regularly within my courses. They provided informative feedback and suggestions that I'm planning to incorporate. What I also really liked was learning from participants' presentations and hearing their stories and experiences integrating generative ai in their courses. I liked the supportive and relational conversation. There is so much that we can learn from each other and provide opportunities to support each other in the teaching journey.

Evidence of Instructional Change

evidence of instructional change
Picture of video used in GenAI Portfolio	Picture of example of chatgpt critique

Practice and Reflect Teaching and Learning with AI:

Since the training I have integrated using generative ai in my teaching practices along with educating students on how they can use it as a tool for empowerment, critical thinking and bridging the divide of access to knowledge. I believe that this is an important tool for equity. I also teach at Sacramento City College at which I'm on the Planning, Research & Institutional Effectiveness Committee. In this last year, we have had discussions on integrating generative ai in our teaching practices and empowering students with the tools. We just had a meeting the other friday in which I shared my effort in informing students in how to use chatgpt. I shared that I think that it will be important for our learning community to not only had trainings for faculty but even so more important - trainings for students. There is another faculty who is leading this developing program and I plan to help them.

I think a huge challenge is that students in general are not aware of how to use generative ai as a tool and have fears that it's for irresponsible use. I'm trying to teach students how they can use it as a tool, for example making study notes, brainstorming, etc. I think that if we teach students that it's a tool and empower them that they have the critical thinking skills to discern the effectiveness of chatgpt, then they will feel more empowered in themselves and that will support their educational attainments.

Thank you for this informative training!

Course Syllabus

CHAD 35 Sp24 Syllabus.docx

Faculty Bio

Meet the Instructor

My name is Veronika Kolesnikov or for short "Prof K." I have three children: tony, bach and coco (you can view their pictures on the welcome letter Link). I have been conducting research on human trafficking since 2007. I have presented at multiple conferences including the APA Symposium in Paris, France in 2019.

My last conference presentationwas on March 9th, 2023 in Brussels, Belgium. It was an honor to share my new teaching technique with other psychology professionals. Oh and I ate a lot of yummy food!

One of my new interests is literacy, brain development and adverse childhood experiences. I have presented multiple times at the Charlotte Huck Children's Literature Festival. In 2020, I presented on the topic of "Every Child has a Story" in which I discussed cognitive development, literacy and engagement. I'm also writing two children's picture books.

I enjoy gardening, cooking and eating of course. I just completed my third marathon - the California International Marathon in December, 2022. I completed the Marin Ultra Challenge 50K in June, 2023 which I hope to try in 2024 again. In September 2023, I also did my first Metric Century Challenge cycling race wohoo! I enjoy kayaking and hiking. In April, I did a 40 mile race to celebrate my 40th bday and I did my first triathlon in July.

I'm also super excited to start a PhD program in Human Development this Fall 2024, wohoo! I'm so excited! Please share any studying/time organizing techniques with me. Thank you!

Funding
	This work was supported by: US Department of Education Hispanic Serving Institution Project TECH4Equity US Department of Education Hispanic Serving Institution Project STEM4Equity P031C210012 *Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation or the US Department of Education.