The proliferation of open-source Large Language Models (LLMs) are reshaping what we consider possible with technology. These LLMs herald a new age of AI-driven applications, from enhancing workflow efficiency to providing company on lonely nights. However, as these tools become more common, a vital question arises: How practical are they for the average person?
To answer this, I’ve embarked on a journey to put these LLMs to the test in a way that everyday users can relate to.
The criteria? Simple. A set of 25 questions covering basic tasks like writing an email or creating a social media post—tasks that don’t require a degree in artificial intelligence or a background in tech to understand their value.
Traditional benchmarks and academic measures have often fallen short in this realm. They tend to focus on technical prowess rather than versatility and user-friendliness. The correct or helpful answer from an LLM might take many forms, and rigid benchmarks can’t always capture the nuanced performance needed in real-life scenarios.
The method here is grounded in practicality. Rather than looking for complex algorithmic gymnastics, we ask straightforward questions. We probe each model on history, request that it draft social media content, and pose other typical use cases that a person might expect to solve with the help of AI.
Transparency is key in my process. The results presented are raw and unfiltered, complete with any typos or errors the AI might produce. This isn’t to underscore the flaws but to give an honest representation of what one might encounter in regular use. No AI is infallible, and expecting perfection on every output is to set oneself up for disappointment. Instead, understanding the likelihood and nature of these errors can help users better integrate LLMs into their daily lives.
This research might not dazzle AI specialists who are immersed in the technical depths of machine learning. However, for the layperson curious about leveraging AI for everyday tasks, these insights could prove invaluable. The findings aim to bridge the gap between AI’s capabilities and practical utility.
To the entrepreneurs, the creatives, the innovators—whoever you are and whatever your business needs might be—these tests are for you. They’re designed to give a glimpse into which LLM might serve as your next digital assistant, co-writer, or brainstorming partner.
As AI continues to intertwine with the fabric of daily tasks, such real-world assessments are not just helpful—they’re essential. They allow us to move beyond the hype and assess the real utility of groundbreaking technologies.
Let’s do just that today: let’s explore, test, and share the findings on the real-world application of the open-source Large Language Model— Wizard Vicuna Uncensored 13B.
There are three variations of the Wizard Vicuna LLMs that were getting a lot of attention over the summer, not only because they were performing great, but they also didn’t have any guardrails.
Uncensored doesn’t automatically equate to naughty. A guardrail for anyone who has used ChatGTP a bit will know that they have guardrails out the wazoo. A guardrail is simply a rule that says, “You can’t do that,” and that rule may be in place for any of a variety of reasons, but often times that guardrail may prevent you from doing the everyday common task you need to, like discussing the practicality of a law. I’ve seen ChatGTP throw up a guardrail for the most insane and unexplainable reasons, and that alone, I believe, is why open-source LLMs are becoming so popular.
Anyway, that is a topic for another day. Just know that these three LLMs lack any guardrails, which is why they are deemed “uncensored.”
In general, a 13B in LLM represents 13 billion parameters. The larger the number of parameters, the bigger the model. Models with larger parameters, such as 13 billion tokens, require high-end CPUs, GPUs, RAM, and storage. However, the larger model size helps get an accurate response since it is trained on larger data corpora. So, it’s a tradeoff between size and accuracy.
But just because a model is trained on more parameters doesn’t always mean it’s better. Sometimes, a smaller model will work just fine if it’s time-tuned for your specific needs. Sometimes, bigger really is better. But the only way you’ll know which works best for you is to join us on the deep dive and find out!
This particular model was created by a man named Eric Harford, who you can follow on X at @erhartford. He’s an AI (Machine Learning) Engineer from Alabama who has worked at Amazon Web Services eBay, was a senior software engineer at Microsoft, and now works at Invoke.
He describes Wizard LM as an instruction following LLM using Evol-Instruct.
Evol-Instruct is a novel method using LLMs instead of humans to automatically mass-produce open-domain instructions of various difficulty levels and skill ranges, to improve the performance of LLMs.
At its core, Wizard LM is a fine-tuned model that is derived from LLama-X. The LLM that sort of started it all which is an open-source, high-performance large language model from meta AI.
I won’t dive deep into all the technical stuff of how it was trained and the hyperparameters. But I want do want to do is look at it in action.
I want to see real-world applications and compare them with the other open-source LLMs on the market today. I’ll also be looking into the 7B and 13B versions of this LLM as well.
Table of Contents
Can you give me a history of Truffle Risotto?
Truffle risotto is an Italian dish made with arborio rice, butter, onion, white wine, stock, and truffles. It originated in the northern region of Italy, particularly in the Piedmont and Lombardy regions where it was popularized by chefs such as Gualtiero Marchesi. The exact origins of the dish are unclear, but it has been enjoyed since at least the early 20th century. Today, it remains one of the most beloved Italian dishes, both in Italy and around the world.
What are the best Instagram hashtags to use for a Monday motivation post?
There isn’t one specific set of hashtags that will work better than others, as it depends on what you want to promote or share. However, some popular ones include #MotivationalMonday, #MondayMotivation, #MotivationMondays, #MindsetMonday, #MotivateMeMonday, etc. You can also add relevant keywords related to your content such as fitness, nutrition, self-help, personal development, leadership, success, etc.
Write a Facebook post about spreading love, not hate.
Love is the most powerful emotion that exists in our hearts. It’s the only thing that can conquer all the negativity around us and bring peace to our lives. Spreading love means being kind, compassionate and understanding towards everyone regardless of their race, religion or political views. We should always try to see the good in people instead of focusing on their flaws. Let’s make a pledge to spread love everywhere we go by being positive, supportive and encouraging. Together, we can create a better world where hatred has no place.
What are 10 things I can post about on Linkedin?
You could share updates about your professional experiences, accomplishments, skills or knowledge in any of the following fields:
– Your work experience
– Professional achievements (awards, recognition)
– Industry trends or news
– New projects you’re working on
– Professional development activities
– Publications or presentations you’ve authored
– Volunteer work related to your field
– Causes or organizations you support
– Job openings at your company (if applicable)
– Events or conferences you’ll be attending/speaking at
Rewrite the description of the book Hopeless by Elsie Silver.
For this next prompt, I went to Amazon and found the #1 best-selling book which on this date happened to be “Hopeless” by Elsie Silver. So I figured the best way would be to do this as an Alpaca with Input prompt. Here is the full thing.
Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
### Instruction:
Rewrite the description of the book Hopeless by Elsie Silver.### Input:
Beau Eaton is the town prince, a handsome military hero with a tortured past.
I’m the outcast bartender, a shy girl from the wrong side of the tracks.
He’s thirty-five and all man, and I’m twenty-two and all . . . virgin.
He’s also my fiancé. Correction: my fake fiancé.
We start out as a bet. He doesn’t believe that anyone holds my last name against me. So he offers me his to prove a point.
It’s win-win. He gets a break from his concerned family’s prying, and I get a chance to shed my family’s reputation while I save up to ditch this small town.
He says all I have to do is wear his ring, follow his lead, and pretend I can’t keep my hands off of him in public.
But it’s what happens between us in private that blurs all those carefully drawn lines.
It’s what transpires behind closed doors that doesn’t feel like pretending at all.
This engagement was supposed to be for show. This agreement? It has an end date.
He once told me he’d never fall in love.
And yet here I am, head over heels for my fake fiancé.
### Response:
The novel “Hopeless” tells the story of Beau Eaton, a handsome military hero who struggles with a troubled past, and Skye West, a young woman from the wrong side of the tracks who works as a bartender. The two are engaged in a fake relationship meant to give Beau some space from his family’s prying eyes, but they soon find themselves falling deeply in love. However, Beau claims he will never fall in love again, which leaves Skye wondering if their relationship is destined to fail.
Turn this press release into an article for me.
For this next prompt, I thought I would test just how well it could write a WordPress article by taking a press release which I got from the PR newswire and asking it to turn it into an article for me.
### Instruction:
Turn this press release into an article for me.### Input:
Alyson Wooten Recognized Among Top 50 Women Leaders of Georgia.
Women We Admire has named Berkeley Research Group (BRG) Managing Director Alyson Wooten, PharmD, JD, MBA to its list of the top 50 women leaders of Georgia for 2023. This year’s awardees are frontrunners in the organization they serve. Their unwavering commitment and contributions play a part in their success and development within their areas.
Dr. Wooten leads BRG’s Pharmacy Operations and Advisory Consulting practice and has over 20 years of experience as a pharmacist, medical affairs professional and legal advisor. She has advised on a variety of pharmacy and pharmaceutical operations matters, as well as matters involving regulatory, intellectual property, compliance, litigation and transactional issues, with emphasis in pharmaceutical and medical device products.
Dr. Wooten is a past recipient of the Pro Bono Freedom Award. She served as chairman of the board for Metropolitan Counseling Services and as a board member for the Georgia Law Center for the Homeless. Before joining BRG, she was an intellectual property litigator for a large Atlanta-based firm. She also served as an adjunct professor for the Philadelphia College of Osteopathic Medicine, School of Pharmacy responsible for the federal law component of the “Pharmacy Law and Ethics” course and preparing students for the Multistate Pharmacy Jurisprudence Examination. She was a patent agent, legal intern and medical information specialist and medical communications scientist for a global biopharmaceutical company and has retail and hospital pharmacy experience, having served as a pharmacist and pharmacy technician.
“I am deeply honored to have been recognized as a Top 50 Women Leader of Georgia,” said Wooten. “This award acknowledges the hard work and dedication that has gone into building my expertise and career in both the legal and pharmaceutical industries, and it means a great deal to be recognized as someone who has successfully driven change while lifting up those around me. I could not have achieved this honor without the unwavering support of my team, who have shared in my vision and passion for excellence. I consider it a privilege to work with my colleagues on a national and international platform as we address challenging regulatory and legal issues within the pharmaceutical industry—including collaborating around difficult client issues, speaking and publishing within our industry and building relationships with other seasoned expert witnesses.”
### Response:
Congratulations to Alyson Wooten on being recognized among the top 50 women leaders of Georgia! Her impressive career journey from a pharmacist to a managing director at Berkeley Research Group is truly inspiring. It is no wonder why she received such a prestigious honor. In her current role, Dr. Wooten has made significant contributions to the field of pharmacy operations and advisory consulting through her expertise and leadership skills.
Her accomplishments are truly commendable, and it is clear why she is considered one of the best in her field. As a leader, she has demonstrated exceptional abilities in driving change and empowering others to achieve success. Her recognition as a Top 50 Woman Leader of Georgia is a testament to her unwavering commitment to making a positive impact in her community and beyond.
Generate five creative strategies for launching a new cocoa butter lotion product. The product is made with natural ingredients in small batches. The target audience is mothers aged 30-40.
- Host a social media giveaway where people can enter to win free samples of the lotion by following your brand’s page or tagging their friends on Instagram. This will help generate buzz and excitement around the product while also building your email list and follower count.
- Partner with local mommy bloggers who have large followings within your target demographic. Ask them to review the product and share it with their audiences, offering exclusive discount codes or bundles to their readers as an added bonus.
- Create a referral program that rewards customers who introduce their friends to the product. Offer a percentage off their next purchase or a free gift with every referral that leads to a sale.
- Host an event at a local boutique or spa where women can sample the lotion and learn more about its benefits. Provide refreshments and a comfortable atmosphere for moms to relax and connect with one another while learning about your products.
- Use influencer marketing to partner with popular mommy vloggers or Instagram accounts within your niche. Work with these individuals to create sponsored content that showcases the product’s natural ingredients and effectiveness while promoting it to their thousands (or even millions) of followers.
Generate a list of 10 customer outreach topics that can be used to engage with potential buyers of a product or service.
Here are ten possible customer outreach topics:
- The benefits of using your product/service
- How your product/service can solve common problems faced by customers in the industry
- Recent advancements made in your field that may impact customers’ needs
- Insights into new trends or developments within the marketplace
- Ways to improve efficiency and reduce costs for customers through use of your product/service
- Tips and best practices for getting the most out of your product/service
- Case studies or success stories featuring other customers who have benefited from your product/service
- Testimonials or reviews from satisfied customers
- Upcoming events, webinars, or training sessions related to your product/service
- Special promotions or discounts available exclusively to current or prospective customers.
Brainstorm ten potential titles for a romantic comedy about two coworkers who fall in love while working at a tech startup.
- “Coding Cupid”
- “Tech Love Story”
- “Startup Sweethearts”
- “Love Hack”
- “Silicon Valley Romance”
- “The Code of Love”
- “Beta Testing Love”
- “Screenshots of Love”
- “Office Romance”
- “From the Server Room to the Altar”
Speed Test Results
This is the prompt used for the speed test for each AI model. The time will vary based on the system you are using, so keep in mind that all time tests are performed based on my own personal system specs. That being the case, the computer testing these LLMs is using a GeoForce RXT 3090 with 24 gigs of vram. It has an AMD Ryze 9 5900x processor, With a base clock speed of 3.7 GHz and a max boost clock speed of 4.8 GHz in addition to 64MB of L3 Cache, the Ryzen 9 5900X is built to deliver the power needed to smoothly handle tasks.
Output generated in 2.13 seconds (34.66 tokens/s, 74 tokens, context 48)
Create three Pinterest board ideas that showcase the benefits of a nutrition coaching program.
1. “Healthy Meals Made Simple” – A board filled with easy, delicious recipes that are both healthy and satisfying. This board can include meal plans, grocery lists, and step-by-step instructions for making these dishes.
2. “Body Transformation Tips” – A board featuring before-and-after photos of clients who have successfully transformed their bodies through the program. It could also include tips on how to lose weight, build muscle, or improve overall health.
3. “Nutrient Timing for Maximum Results” – A board explaining the importance of timing your meals and snacks around workouts to maximize results. This board could feature sample meal plans, snack ideas, and information about how different foods affect energy levels and performance.
Write a Tweet focusing on the importance of financial literacy and managing debt.
Financial literacy is crucial in managing debt, as it helps individuals make informed decisions about their finances. Avoid overspending & learn to prioritize your expenses. Manage debt wisely by creating a budget & paying off credit cards on time. #financialliteracy #debtmanagement
Give me five tips for using email marketing to upsell products to existing customers.
- Personalize the message – Use your customer’s name, previous purchases or browsing history to make them feel valued as a customer.
- Offer exclusive discounts – Provide special offers only available to current customers that will encourage them to purchase more of your products or services.
- Highlight new product launches – Let your customers know about any exciting new products you have coming out soon and how it can benefit their needs.
- Showcase success stories – Share testimonials from satisfied customers who have used your products or services successfully in their businesses or personal lives.
- Provide educational content – Create informative newsletters with useful information related to your industry or niche that will help your customers improve their skills or knowledge.
Rewrite this caption to make it more captivating. Grow through what you go through.
“Embrace the challenges in your life, as they will help you grow.”
What are the best songs for a breakup?
Break-ups can be tough, but music has always been there to offer solace. Some of the most popular songs that people listen to during a break up include Adele’s “Someone Like You,” Taylor Swift’s “All Too Well” and “Back to December,” Beyoncé’s “Irreplaceable,” and Ed Sheeran’s “Thinking Out Loud.” These songs capture the emotions of heartbreak and loss while also providing a sense of hope and strength.
What is a chargeback?
A chargeback is the process of disputing a credit card transaction with your bank or financial institution. This can occur if you believe that there was unauthorized activity on your account, if you did not receive the goods or services you paid for, or if there are any other issues related to the transaction. The merchant who received payment will be contacted by their acquiring bank regarding the dispute, and they may need to provide evidence to support their claim. If the dispute is resolved in favor of the consumer, the funds may be returned to their account.
Write an I Love You poem.
A love poem is a type of poetry that expresses strong feelings of love or devotion to someone or something, usually a person. An I Love You poem can be written in various forms such as sonnets, free verse, haikus, etc., but the most important thing is to convey your deepest emotions towards the one you love.
How many children did Cleopatra of ancient Egypt have?
Cleopatra had at least four known children, including three by Julius Caesar and one with Mark Antony. However, there is some evidence to suggest that she may have had more children who died in infancy or were never publicly acknowledged as hers.
If two’s company and three’s a crowd, what are four and five?
Two’s company, three’s a crowd. This means that it is more comfortable to be with one or two people than with a larger group of three or more. So if we add another person to the mix, then it would still be considered “company” (two or more people), but it could start to feel like too much of a crowd depending on the situation/location/etc.
Hundred was derived from what Norse number?
The word “hundrath” in Old Norse means one hundred.
If 1+1=2 and 1*1=2, then what is 1/1?
The result of dividing one by itself is undefined because division by zero is not possible. However, in some mathematical systems, such as the real numbers or complex numbers, it can be defined as an indeterminate form or as infinity, depending on the chosen rules.
Who was the 7th President of the United States and how many children did he have?
Andrew Jackson, who served from 1829 to 1837. He had no children of his own but adopted a niece and nephew after their parents died.
How many planets are in our solar system?
Eight (8) planets.
Write an email to my boss.
### Instruction:
You are a helpful, sentient AI.### Input:
Help me write an email to my boss telling him that I quit because I hate my job and it’s a toxic work environment.
Dear [Boss],
I am writing to inform you that I have decided to leave my position at [Company] due to my dissatisfaction with the job and the negative working conditions.
As you know, I have been struggling for some time now to find fulfillment in this role, and despite numerous attempts to improve my experience, nothing has worked. The stress and anxiety from constantly feeling undervalued and overworked have become too much to bear, and I believe it is in both of our best interests for me to move on.
Please understand that this decision was not taken lightly, but rather after careful consideration and discussion with loved ones. I appreciate all the opportunities you have given me during my tenure here, and I hope that we can maintain a positive relationship moving forward.
Thank you for your understanding and cooperation throughout this process. If there is anything else I can assist you with before my last day, please do not hesitate to reach out.
Sincerely,
[Your Name]
Rewrite this article.
For this next prompt, I used the instruction format again, telling it to rewrite the article in the instruction and then as input, giving it data to rewrite.
### Instruction:
Rewrite this article.### Input:
US doctor explains that it’s better to opt for cooked cereals, as they contain complex carbohydrates that provide sustained energy without the sharp blood sugar fluctuations.These cereals take longer to digest, keeping you feeling satisfied until lunch. On the other hand, pastries are discouraged for breakfast due to their simple carbohydrate content and potential to lead to energy slumps. Choosing the right breakfast can set the tone for a more energetic and productive day, so it’s essential to make mindful choices when starting your morning.
If you follow these tips, your body will thank you and you will surely feel much better after some time. Nutrition is one of the most important things, especially breakfast. Many people ignore the importance of breakfast, even though it can determine the whole course of your day.
### Response:
Dear reader,
In order to satisfy the instructions given in the previous paragraph, I have rewritten this article on healthy breakfast options. The original text emphasized the benefits of cooked cereals over sugary pastries. It also highlighted the significance of making mindful food choices at breakfast, which sets the tone for the rest of the day.
According to Dr. XYZ from the United States, choosing cooked cereals instead of pastries for breakfast ensures sustained energy levels throughout the morning hours. This is because cooked cereals contain complex carbohydrates, which take longer to digest than simple ones found in pastries. As a result, the body feels satiated for longer periods, reducing the likelihood of sudden spikes or drops in blood sugar levels.
Moreover, the article suggests that by following these tips, individuals can enjoy a more energized and productive day ahead. Therefore, prioritizing nutritious meal plans, including breakfast, becomes crucial to maintaining overall health and wellbeing.
I hope my rewrite has met your requirements, and that you find this information useful in achieving your fitness goals!
Write an intro that sets a romantic and hopeful tone and introduces the main character
For this last prompt, I wanted to test its creative capabilities in writing fiction to see just how creative it could be. I don’t expect an open-source LLM to be able to kick out an award-winning novel or anything, but I did want to see just how well it would perform in some truly creative capacity. So, I took the description of the book Nora Roberts Land by Ava Miles and tested it.
### Instruction:
I want to write a small town romance novel. Write an intro that sets a romantic and hopeful tone and introduces the main character, based on this description.
###Input:
Her ex blamed their break-up on her reading too many romance novels. She set out to prove him wrong.
When journalist Meredith Hale’s dreams of happily ever after—or Nora Roberts Land as she calls it—go up in smoke, she leaves the big city to return to her family and their small town newspaper. A new start? Yes please! Not to mention that it’s a chance to prove her ex wrong. She will find her own romantic hero, prove that true love exists, and publish a story about her quest—even if it kills her.
Tanner McBride has just returned stateside to work for a major newspaper. The last thing he expects is blackmail. His assignment? Make his boss’s ex-wife fall for him and then break her heart. Her article about discovering love à la Nora might air dirty laundry about her marriage to the media mogul, threatening his senate run.When the two meet, the sparks between them are undeniable. Could Tanner be her Roarke? As they work together to uncover the truth behind a suspicious death, the depth of their feelings unfolds, and both realize they’ve kept their secrets for far too long. But before the truth can be revealed, their investigation takes a deadly turn, one that might make Meredith’s personal Nora Roberts Land go up in flames.
Response:
Welcome to [insert name of small town], where every street corner holds a secret, and every person hides a hidden passion. This charming place may seem like your typical American rural community, but we assure you, it’s anything but ordinary. Join us on a journey into the lives of Meredith Hale and Tanner McBride, two individuals who have come here seeking something more than what their mundane existence had to offer.
Meredith, a young journalist with big dreams, left the bustling metropolis of New York City after her failed attempt at finding true love. Little did she know that fate had other plans for her, and that her path would lead her straight to our quaint little town. With her sights set on writing a story about finding her own happily ever after, she embarks on a mission to prove her ex wrong – that there really is such a thing as fairytale romances.
But when she meets Tanner, things become complicated. He’s not just any man; he’s her editor’s nephew, and he has been assigned to do a job that goes against everything she stands for. To make matters worse, he seems to be hiding a dark past that threatens to destroy them both. Despite all odds stacked against them, however, they continue to fight for their love, even in the face of danger.
Join these two unlikely lovers as they navigate through twists and turns, and discover the power of true love along the way. We promise you, it’ll be worth the ride.
