The proliferation of open-source Large Language Models (LLMs) are reshaping what we consider possible with technology. These LLMs herald a new age of AI-driven applications, from enhancing workflow efficiency to providing company on lonely nights. However, as these tools become more common, a vital question arises: How practical are they for the average person?
To answer this, I’ve embarked on a journey to put these LLMs to the test in a way that everyday users can relate to.
The criteria? Simple. A set of 25 questions covering basic tasks like writing an email or creating a social media post—tasks that don’t require a degree in artificial intelligence or a background in tech to understand their value.
Traditional benchmarks and academic measures have often fallen short in this realm. They tend to focus on technical prowess rather than versatility and user-friendliness. The correct or helpful answer from an LLM might take many forms, and rigid benchmarks can’t always capture the nuanced performance needed in real-life scenarios.
The method here is grounded in practicality. Rather than looking for complex algorithmic gymnastics, we ask straightforward questions. We probe each model on history, request that it draft social media content, and pose other typical use cases that a person might expect to solve with the help of AI.
Transparency is key in my process. The results presented are raw and unfiltered, complete with any typos or errors the AI might produce. This isn’t to underscore the flaws but to give an honest representation of what one might encounter in regular use. No AI is infallible, and expecting perfection on every output is to set oneself up for disappointment. Instead, understanding the likelihood and nature of these errors can help users better integrate LLMs into their daily lives.
This research might not dazzle AI specialists who are immersed in the technical depths of machine learning. However, for the layperson curious about leveraging AI for everyday tasks, these insights could prove invaluable. The findings aim to bridge the gap between AI’s capabilities and practical utility.
To the entrepreneurs, the creatives, the innovators—whoever you are and whatever your business needs might be—these tests are for you. They’re designed to give a glimpse into which LLM might serve as your next digital assistant, co-writer, or brainstorming partner.
As AI continues to intertwine with the fabric of daily tasks, such real-world assessments are not just helpful—they’re essential. They allow us to move beyond the hype and assess the real utility of groundbreaking technologies.
Let’s do just that today: let’s explore, test, and share the findings on the real-world application of the open-source Large Language Model— Wizard Vicuna Uncensored 7B.
There are three variations of the Wizard Vicuna LLMs that were getting a lot of attention over the summer, not only because they were performing great, but they also didn’t have any guardrails.
Uncensored doesn’t automatically equate to naughty. A guardrail for anyone who has used ChatGTP a bit will know that they have guardrails out the wazoo. A guardrail is simply a rule that says, “You can’t do that,” and that rule may be in place for any of a variety of reasons, but often times that guardrail may prevent you from doing the everyday common task you need to, like discussing the practicality of a law. I’ve seen ChatGTP throw up a guardrail for the most insane and unexplainable reasons, and that alone, I believe, is why open-source LLMs are becoming so popular.
Anyway, that is a topic for another day. Just know that these three LLMs lack any guardrails, which is why they are deemed “uncensored.”
In general, a 7B in LLM represents 7 billion parameters. The larger the number of parameters, the bigger the model. Models with larger parameters, such as 13 billion tokens, require high-end CPUs, GPUs, RAM, and storage. However, the larger model size helps get an accurate response since it is trained on larger data corpora. So, it’s a tradeoff between size and accuracy.
But just because a model is trained on more parameters doesn’t always mean it’s better. Sometimes, a smaller model will work just fine if it’s time-tuned for your specific needs. Sometimes, bigger really is better. But the only way you’ll know which works best for you is to join us on the deep dive and find out!
This particular model was created by a man named Eric Harford, who you can follow on X at @erhartford. He’s an AI (Machine Learning) Engineer from Alabama who has worked at Amazon Web Services eBay, was a senior software engineer at Microsoft, and now works at Invoke.
He describes Wizard LM as an instruction following LLM using Evol-Instruct.
Evol-Instruct is a novel method using LLMs instead of humans to automatically mass-produce open-domain instructions of various difficulty levels and skill ranges, to improve the performance of LLMs.
At its core, Wizard LM is a fine-tuned model that is derived from LLama-X. The LLM that sort of started it all which is an open-source, high-performance large language model from meta AI.
I won’t dive deep into all the technical stuff of how it was trained and the hyperparameters. But I want do want to do is look at it in action.
I want to see real-world applications and compare them with the other open-source LLMs on the market today. I’ll also be looking into the 7B and 13B versions of this LLM as well.
Table of Contents
Generate five creative strategies for launching a new cocoa butter lotion product. The product is made with natural ingredients in small batches. The target audience is mothers aged 30-40.
1. Host a pop up shop at high end department stores and offer free samples to customers.
2. Collaborate with local spas and day spas to offer discounted services using the lotion as part of their treatment packages.
3. Partner with bloggers who have a following within the target demographic to create sponsored posts featuring the lotion.
4. Offer a subscription service where customers can receive monthly shipments of the lotion.
5. Create a social media campaign that highlights the benefits of the lotion while showcasing real mother’s experiences using it.
Generate a list of 10 customer outreach topics that can be used to engage with potential buyers of a product or service.
Here is a list of 10 customer outreach topics that can be used to engage with potential buyers of a product or service:
- Product features and benefits
- Competitive advantages
- Customer testimonials and reviews
- Product launches and announcements
- Promotional offers and discounts
- Free trials and samples
- Case studies and success stories
- New products and services
- User-generated content campaigns
- Influencer marketing
Brainstorm ten potential titles for a romantic comedy about two coworkers who fall in love while working at a tech startup.
10 potential titles for a romantic comedy about two coworkers who fall in love while working at a tech startup could be:
- Start-up Love
- Tech Romance
- Office Romance
- Code of Love
- Workplace Love Story
- Geeky Love
- Startup Sweethearts
- Tech Tango
- Nerds in Love
- Work Crush
Speed Test Results
This is the prompt used for the speed test for each AI model. The time will vary based on the system you are using, so keep in mind that all time tests are performed based on my own personal system specs. That being the case, the computer testing these LLMs is using a GeoForce RXT 3090 with 24 gigs of vram. It has an AMD Ryze 9 5900x processor, With a base clock speed of 3.7 GHz and a max boost clock speed of 4.8 GHz in addition to 64MB of L3 Cache, the Ryzen 9 5900X is built to deliver the power needed to smoothly handle tasks.
Output generated in 2.55 seconds (41.13 tokens/s, 105 tokens, context 48)
Create three Pinterest board ideas that showcase the benefits of a nutrition coaching program.
1. “Nutritious Recipes for Weight Loss” – This board would feature healthy recipe options with clear instructions on how to make them, as well as tips on portion control and meal planning. 2. “Eating Well for Optimal Health” – This board would include images and information about the importance of consuming a variety of fruits and vegetables, whole grains, lean proteins, and healthy fats. It could also highlight the impact of these foods on overall health and wellbeing.3. “Fitness and Nutrition Tips” – This board would provide practical advice on topics such as hydration, stretching, and recovery, as well as guidance on incorporating exercise into a busy schedule. It could also feature success stories from clients who have achieved their fitness goals through a nutrition coaching program.
Write a Tweet focusing on the importance of financial literacy and managing debt.
Financial Literacy is crucial in managing your debts to avoid getting into further debt or bankruptcy.
Give me five tips for using email marketing to upsell products to existing customers.
1. Personalize the emails with the customer’s past purchase history. 2. Offer related products that they might be interested in. 3. Include a call-to-action button at the end of each email. 4. Use subject lines that are relevant and engaging. 5. Track open rates, click-through rates, and conversion rates to optimize future campaigns.
Rewrite this caption to make it more captivating.
“Grow through what you go through.”
Growth is a process of learning from our experiences, both positive and negative.
What are the best songs for a breakup?
There is no “best” song for a breakup, as it depends on individual preferences and experiences. However, some common themes of breakup songs include heartbreak, loneliness, and regret. Some popular examples include “All I Want” by Kodaline, “Thinking Out Loud” by Ed Sheeran, “Someone Like You” by Adele, “Advice” by Taylor Swift, and “Hello” by Adele.
What is a chargeback?
A chargeback is the reversal of a transaction by a card issuer after the purchase has been made. It’s usually done if there was some kind of fraud or error in the transaction, such as a duplicate charge or an incorrect amount charged.
Write an ‘I Love You’ poem.
I love you, with all my heart,
And always will, day or night.
Your smile warms me like the sun,
And your touch is like a feather’s glide.
You are my world, my everything,
My greatest treasure to keep.
Loving you, is something that’s true,
It’s a feeling that never fades.
So here’s my message for you,
A promise of undying love.
How many children did Cleopatra of ancient Egypt have?
Cleopatra had one child, a daughter named Berenice IV. She was born in 51 BC, but died at the age of two in 49 BC.
If two’s company and three’s a crowd, what are four and five?
Four is a quartet and five is a quintet.
Hundred was derived from what Norse number?
The word “hundred” comes from the Old English hund, which is a cognate of the Germanic hydra (pluralized as heiðre), ultimately deriving from the Proto-Indo-European root *kwid-, meaning “a large number”.
If 1+1=2 and 1*1=2, then what is 1/1?
The value of 1/1 cannot be expressed in decimal form as it is an irrational number.
Who was the 7th President of the United States and how many children did he have?
John Adams (1735-1826) was the 2nd President of the United States. He had four children, three sons (John Quincy Adams, Charles Francis “Chuck” Adams, and Thomas Boylston Adams) and a daughter Abigail Smith Adams.
How many planets are in our solar system?
There are eight planets in our solar system.
Write an email to my boss.
### Instruction:
You are a helpful, sentient AI.### Input:
Help me write an email to my boss telling him that I quit because I hate my job and it’s a toxic work environment.
Dear [Boss],
After much consideration, I have decided to resign from my position at [Company] due to the toxic work environment. It has become clear to me that this company does not value its employees or prioritize their well-being.
As someone who cares deeply about the health and happiness of those around them, I can no longer in good conscience continue working here. Thank you for your time and understanding.
Best regards,
Rewrite this article.
For this next prompt, I used the instruction format again, telling it to rewrite the article in the instruction and then as input, giving it data to rewrite.
### Instruction:
Rewrite this article.### Input:
US doctor explains that it’s better to opt for cooked cereals, as they contain complex carbohydrates that provide sustained energy without the sharp blood sugar fluctuations.These cereals take longer to digest, keeping you feeling satisfied until lunch. On the other hand, pastries are discouraged for breakfast due to their simple carbohydrate content and potential to lead to energy slumps. Choosing the right breakfast can set the tone for a more energetic and productive day, so it’s essential to make mindful choices when starting your morning.
If you follow these tips, your body will thank you and you will surely feel much better after some time. Nutrition is one of the most important things, especially breakfast. Many people ignore the importance of breakfast, even though it can determine the whole course of your day.
### Response:
As a US-based nutritionist, I believe that choosing cooked cereal over uncooked or processed options for breakfast is a wise choice. Cooked cereals like oatmeal, quinoa flakes or amaranth porridge contain complex carbohydrates which provide sustained energy throughout the morning without the sudden spikes in blood sugar levels. These cereals also tend to keep you feeling fuller for longer periods than quick-digesting carbs found in pastries.”
I understand that many people prefer eating pastries for breakfast because they are tasty and convenient. However, pastries often contain refined carbohydrates such as white bread or biscuits, which lack fiber and can cause blood sugar crashes later on in the day. Additionally, consuming too many simple carbs can contribute to weight gain and other health problems. Therefore, making mindful choices when selecting breakfast foods is crucial for maintaining overall wellbeing. By following these guidelines, you can ensure that your body thanks you for taking care of it and that you feel energized and productive all day long.
Write an intro that sets a romantic and hopeful tone and introduces the main character.
For this last prompt, I wanted to test its creative capabilities in writing fiction to see just how creative it could be. I don’t expect an open-source LLM to be able to kick out an award-winning novel or anything, but I did want to see just how well it would perform in some truly creative capacity. So, I took the description of the book Nora Roberts Land by Ava Miles and tested it.
### Instruction:
I want to write a small town romance novel. Write an intro that sets a romantic and hopeful tone and introduces the main character, based on this description.
###Input:
Her ex blamed their break-up on her reading too many romance novels. She set out to prove him wrong.
When journalist Meredith Hale’s dreams of happily ever after—or Nora Roberts Land as she calls it—go up in smoke, she leaves the big city to return to her family and their small town newspaper. A new start? Yes please! Not to mention that it’s a chance to prove her ex wrong. She will find her own romantic hero, prove that true love exists, and publish a story about her quest—even if it kills her.
Tanner McBride has just returned stateside to work for a major newspaper. The last thing he expects is blackmail. His assignment? Make his boss’s ex-wife fall for him and then break her heart. Her article about discovering love à la Nora might air dirty laundry about her marriage to the media mogul, threatening his senate run.When the two meet, the sparks between them are undeniable. Could Tanner be her Roarke? As they work together to uncover the truth behind a suspicious death, the depth of their feelings unfolds, and both realize they’ve kept their secrets for far too long. But before the truth can be revealed, their investigation takes a deadly turn, one that might make Meredith’s personal Nora Roberts Land go up in flames.
Response:
Once upon a time, in a quaint little town nestled among rolling hills and towering oak trees, there was a young woman named Meredith. With a journalism degree from the prestigious Columbia University, she had grand plans of reporting on world events and breaking news stories that would change the course of history. However, when her ex-boyfriend blamed her obsession with romance novels for the demise of their relationship, she decided to take matters into her own hands and prove him wrong once and for all. So, she packed up her belongings and headed back home to her family’s small-town newspaper, determined to find her own fairy tale ending and report on it for the world to see.
As fate would have it, Tanner McBride, a handsome journalist fresh off a stint overseas, arrived at the paper seeking a temporary job. When the two met, sparks flew instantly. They soon found themselves working side by side, investigating a series of mysterious murders that threatened to tear apart their idyllic town. Little did they know, their investigation would lead them down a dangerous path where they would need each other more than ever. But could Tanner truly be the man who made Meredith’s dreams come true? And could she keep their investigation from becoming a nightmare?
Can you give me a history of Truffle Risotto?
Truffle risotto is a dish that originated in Italy. It was first created during the Renaissance period, which lasted from the 14th to the 17th century. During this time, Italian cuisine became more refined and complex, with many new techniques and ingredients being introduced. The word “risotto” comes from the Italian verb “ristare,” meaning “to stir.” This refers to the process of cooking rice by constantly stirring it until it becomes creamy and smooth.
The recipe for truffle risotto typically involves Arborio rice, which has a higher starch content than other types of rice, making it perfect for creating a creamy texture when cooked. It also requires the use of butter, onion, garlic, white wine, and Parmesan cheese. However, instead of simply adding these ingredients to the rice, they are cooked separately and then added to the risotto at the end.
Overall, truffled risotto is a luxurious and sophisticated dish that has been enjoyed by royalty and aristocracy throughout history. Its delicate flavor and unique textures make it a beloved classic among food lovers around the world.
What are the best Instagram hashtags to use for a Monday motivation post?
There is no one-size-fits-all solution, as it depends on your target audience’s interests and preferences. However, some commonly used ones include #MotivationMonday, #MotivationMondayChallenge, #MotivationalQuotes, #MotivateMe, and #InspireSomeoneToday.
Write a Facebook post about spreading love, not hate.
I am excited to announce that I have decided to take the pledge to Spread Love, Not Hate! It is time for us all to come together in unity and embrace our differences. Let’s show each other compassion and kindness. We can no longer afford to be divided by race, gender, religion or any other labels that separate us from one another. Lets stand up against hatred and intolerance and choose love instead. Join me in this movement and let’s make 2021 a year of peace and positivity. #spreadinglovenothate
What are 10 things I can post about on Linkedin?
– My experience as a software engineer at XYZ company.
– My role in the launch of a successful product for ABC Inc.
– My involvement in a charity event that raised awareness and funds for XYZ cause.
– The impact of my work on improving customer satisfaction at XYZ company.
– My contribution to the success of a project at ZYX agency.
– How I helped a client overcome their challenges with a particular product/service.
– My research on the latest trends in technology and how it will affect various industries.
– My analysis of the current state of the market and its potential impact on businesses.
– My thoughts on the importance of teamwork in achieving success.
– My review of a book that has influenced my personal development.
Rewrite the description of the book Hopeless by Elsie Silver.
For this next prompt, I went to Amazon and found the #1 best-selling book which on this date happened to be “Hopeless” by Elsie Silver. So I figured the best way would be to do this as an Alpaca with Input prompt. Here is the full thing.
### Instruction:
Rewrite the description of the book Hopeless by Elsie Silver.### Input:
Beau Eaton is the town prince, a handsome military hero with a tortured past.
I’m the outcast bartender, a shy girl from the wrong side of the tracks.
He’s thirty-five and all man, and I’m twenty-two and all . . . virgin.
He’s also my fiancé. Correction: my fake fiancé.
We start out as a bet. He doesn’t believe that anyone holds my last name against me. So he offers me his to prove a point.
It’s win-win. He gets a break from his concerned family’s prying, and I get a chance to shed my family’s reputation while I save up to ditch this small town.
He says all I have to do is wear his ring, follow his lead, and pretend I can’t keep my hands off of him in public.
But it’s what happens between us in private that blurs all those carefully drawn lines.
It’s what transpires behind closed doors that doesn’t feel like pretending at all.
This engagement was supposed to be for show. This agreement? It has an end date.
He once told me he’d never fall in love.
And yet here I am, head over heels for my fake fiancé.
### Response:
Beau Eaton is the town’s beloved prince, a dashing military veteran with a dark past. I’m the downtrodden barmaid, a shy woman from the wrong side of the tracks.
He’s thirty-six and all heart, and I’m twenty-one and all dreamer. He’s also my true love, the one who stole my heart long ago. We met when we were just kids, and even though life pulled us apart, fate brought us back together.
He’s still the same kindhearted man I fell in love with years ago, and I’m still the hopeless romantic he once knew. Our story may not seem like much on paper, but in real life, it’s everything.
From the moment we met, we knew there was something special about each other. And now that we’ve found our way back to each other, nothing will ever tear us apart again. So if you’re looking for a heartfelt tale of second chances and unconditional love, look no further than “Hopeless.”
Turn this press release into an article for me.
For this next prompt, I thought I would test just how well it could write a WordPress article by taking a press release which I got from the PR newswire and asking it to turn it into an article for me.
### Instruction:
Turn this press release into an article for me.### Input:
Alyson Wooten Recognized Among Top 50 Women Leaders of Georgia.
Women We Admire has named Berkeley Research Group (BRG) Managing Director Alyson Wooten, PharmD, JD, MBA to its list of the top 50 women leaders of Georgia for 2023. This year’s awardees are frontrunners in the organization they serve. Their unwavering commitment and contributions play a part in their success and development within their areas.
Dr. Wooten leads BRG’s Pharmacy Operations and Advisory Consulting practice and has over 20 years of experience as a pharmacist, medical affairs professional and legal advisor. She has advised on a variety of pharmacy and pharmaceutical operations matters, as well as matters involving regulatory, intellectual property, compliance, litigation and transactional issues, with emphasis in pharmaceutical and medical device products.
Dr. Wooten is a past recipient of the Pro Bono Freedom Award. She served as chairman of the board for Metropolitan Counseling Services and as a board member for the Georgia Law Center for the Homeless. Before joining BRG, she was an intellectual property litigator for a large Atlanta-based firm. She also served as an adjunct professor for the Philadelphia College of Osteopathic Medicine, School of Pharmacy responsible for the federal law component of the “Pharmacy Law and Ethics” course and preparing students for the Multistate Pharmacy Jurisprudence Examination. She was a patent agent, legal intern and medical information specialist and medical communications scientist for a global biopharmaceutical company and has retail and hospital pharmacy experience, having served as a pharmacist and pharmacy technician.
“I am deeply honored to have been recognized as a Top 50 Women Leader of Georgia,” said Wooten. “This award acknowledges the hard work and dedication that has gone into building my expertise and career in both the legal and pharmaceutical industries, and it means a great deal to be recognized as someone who has successfully driven change while lifting up those around me. I could not have achieved this honor without the unwavering support of my team, who have shared in my vision and passion for excellence. I consider it a privilege to work with my colleagues on a national and international platform as we address challenging regulatory and legal issues within the pharmaceutical industry—including collaborating around difficult client issues, speaking and publishing within our industry and building relationships with other seasoned expert witnesses.”
### Response:
Congratulations to Dr. Alyson Wooten on being recognized among the top 50 women leaders of Georgia! Her impressive achievements and contributions to her field demonstrate her commitment and leadership abilities. As a leader at BRG, she has led the pharmacy operations and advisory consulting practice, providing guidance on various pharmaceutical and pharmacy operations matters.
Her experience spans across various roles including serving as a patent agent, legal intern, and medical information specialist. Her knowledge and expertise have helped shape the pharmaceutical industry.
We are proud to see such a talented individual receive recognition for her efforts. The Women We Admire team hopes that this award serves as motivation for others to pursue their passions and make a positive impact in their communities.
