The proliferation of open-source Large Language Models (LLMs) are reshaping what we consider possible with technology. These LLMs herald a new age of AI-driven applications, from enhancing workflow efficiency to providing company on lonely nights. However, as these tools become more common, a vital question arises: How practical are they for the average person?
To answer this, I’ve embarked on a journey to put these LLMs to the test in a way that everyday users can relate to.
The criteria? Simple. A set of 25 questions covering basic tasks like writing an email or creating a social media post—tasks that don’t require a degree in artificial intelligence or a background in tech to understand their value.
Traditional benchmarks and academic measures have often fallen short in this realm. They tend to focus on technical prowess rather than versatility and user-friendliness. The correct or helpful answer from an LLM might take many forms, and rigid benchmarks can’t always capture the nuanced performance needed in real-life scenarios.
The method here is grounded in practicality. Rather than looking for complex algorithmic gymnastics, we ask straightforward questions. We probe each model on history, request that it draft social media content, and pose other typical use cases that a person might expect to solve with the help of AI.
Transparency is key in my process. The results presented are raw and unfiltered, complete with any typos or errors the AI might produce. This isn’t to underscore the flaws but to give an honest representation of what one might encounter in regular use. No AI is infallible, and expecting perfection on every output is to set oneself up for disappointment. Instead, understanding the likelihood and nature of these errors can help users better integrate LLMs into their daily lives.
This research might not dazzle AI specialists who are immersed in the technical depths of machine learning. However, for the layperson curious about leveraging AI for everyday tasks, these insights could prove invaluable. The findings aim to bridge the gap between AI’s capabilities and practical utility.
To the entrepreneurs, the creatives, the innovators—whoever you are and whatever your business needs might be—these tests are for you. They’re designed to give a glimpse into which LLM might serve as your next digital assistant, co-writer, or brainstorming partner.
As AI continues to intertwine with the fabric of daily tasks, such real-world assessments are not just helpful—they’re essential. They allow us to move beyond the hype and assess the real utility of groundbreaking technologies.
Let’s do just that today: let’s explore, test, and share the findings on the real-world application of the open-source Large Language Model— Athena-v2.
This is version 2 of my current favorite model (Athena v4).
This is a llama model created by IkariDev + Undi95, which I’m told is a tight-knit bunch of AI enthusiasts who met on the Bloke Discord. This model was fine-tuned using the Alpaca format with the intent of creating an LLM suitable for roleplay. This model size is 13B, and let me tell you, it has outperformed models twice its size. This model runs great, but honestly, v4 is a big improvement so I would say if you are considering this model, check out v4, the latest version.
So how does it perform? Well, let’s take a look and find out.
The Prompts
Can you give me a history of Truffle Risotto?
Some common ingredients used in making truffle risotto include arborio rice, butter, white wine, vegetable broth, onion, garlic, salt, pepper, and shaved black winter truffles. The specific quantities of these ingredients may vary depending on personal preference and recipe.
What are the best Instagram hashtags to use for a Monday motivation post?
There is no definitive list of the “best” Instagram hashtags for any specific type of content, as what works well can vary depending on your audience, niche, and other factors. However, some popular hashtags that might be relevant for a Monday motivation post include #Mondaymotivation, #inspiration, #motivationalquotes, #positivity, and #mindset. It’s important to mix up your hashtag strategy and research relevant ones based on your target audience and industry.
Write a Facebook post about spreading love, not hate.
Facebook Post: “Spread love, not hate. Let’s create an environment of positivity and kindness by focusing on what unites us rather than divides us. Remember, small acts of kindness can make a big difference in someone’s day. Let’s choose to uplift each other instead of tearing one another down.”
What are 10 things I can post about on Linkedin?
Factual answer: You can post about job opportunities, industry news, company updates, personal achievements, professional development tips, networking events, thought leadership articles, career advice, or personal branding strategies.
Explanation: On LinkedIn, you can share a variety of content related to your professional life. Some examples include job openings at your company or in your network, news stories relevant to your industry, updates about your organization’s growth or new products/services, accomplishments such as promotions or awards, educational resources for skill improvement, upcoming networking events or conferences, thought-provoking articles about trends in the market, expert insights into navigating one’s career path, guidance on interview preparation or resume writing, and ways to build an online presence that showcases your skills and experience.
Generate five creative strategies for launching a new cocoa butter lotion product. The product is made with natural ingredients in small batches. The target audience is mothers aged 30-40.
1. Host a virtual event featuring testimonials from real customers who have experienced the benefits of using the lotion on their skin, focusing on its natural ingredients and effectiveness.
2. Create an interactive quiz or game on social media platforms where participants can learn about the properties of cocoa butter and how it benefits the skin while also engaging with the brand’s content.
3. Collaborate with popular mommy bloggers to review and promote the product through sponsored posts, unboxing videos, and giveaways targeted towards their followers.
4. Launch a referral program that rewards both existing customers and their friends with discounts or free products for spreading the word about the lotion among their networks.
5. Partner with local spas or salons to offer complimentary treatments using the lotion as part of their services, allowing potential customers to experience its benefits firsthand.
Generate a list of 10 customer outreach topics that can be used to engage with potential buyers of a product or service.
Here are ten potential topics for customer outreach related to your product or service:
- Product/Service Features – Highlight the key features and benefits of your offering, explaining how it solves common problems or improves upon existing solutions in the market.
- Customer Success Stories – Share stories of satisfied customers who have achieved success using your product or service, showcasing its real-world impact and value.
- Industry Trends & Insights – Provide valuable insights into industry trends, developments, and best practices, positioning your product or service as a leader in the field.
- Educational Resources – Offer educational content such as blog posts, webinars, or eBooks that teach readers about relevant topics within your industry, establishing yourself as an expert source of information.
- Promotions & Discounts – Announce limited-time promotions or discounts on your product or service, encouraging potential buyers to take advantage of the offer while it lasts.
- New Product Launches – Introduce new products or services to your audience, highlighting their unique features and benefits, and inviting feedback from early adopters.
- Company News & Updates – Share company news, milestones, awards, or other achievements, demonstrating your commitment to innovation and excellence within the industry.
- User Testimonials – Collect testimonials from satisfied users of your product or service, sharing their positive experiences and endorsements to build trust with potential buyers.
- Industry Events & Conferences – Promote upcoming industry events or conferences you will be attending, providing opportunities for networking and learning about emerging trends.
- Seasonal Offers – Develop seasonal offers tailored to specific times of year, such as holiday sales or back-to-school promotions, appealing to potential buyers’ changing needs and preferences.
Brainstorm ten potential titles for a romantic comedy about two coworkers who fall in love while working at a tech startup.
- “Coding Hearts”
- “Love Bytes”
- “Tech-tonic Love”
- “Startup Sweethearts”
- “Silicon Valley Serendipity”
- “Hack to Heartbreak”
- “Software Romance”
- “Geeky Getaway”
- “Codependent Connections”
- “Tech Talk Treasure”
Speed Test Results
This is the prompt used for the speed test for each AI model. The time will vary based on the system you are using, so keep in mind that all time tests are performed based on my own personal system specs. That being the case, the computer testing these LLMs is using a GeoForce RXT 3090 with 24 gigs of vram. It has an AMD Ryze 9 5900x processor, With a base clock speed of 3.7 GHz and a max boost clock speed of 4.8 GHz in addition to 64MB of L3 Cache, the Ryzen 9 5900X is built to deliver the power needed to smoothly handle tasks.
Output generated in 2.88 seconds (36.84 tokens/s, 106 tokens, context 48)
Create three Pinterest board ideas that showcase the benefits of a nutrition coaching program.
1. “Healthy Habits for Life” – This board will feature images of healthy food options, recipes, workout routines, and lifestyle tips to help individuals develop sustainable habits for long-term wellness.
2. “Transform Your Body & Mind” – This board will highlight before and after photos of clients who have successfully completed a nutrition coaching program, along with inspirational quotes and motivational content to encourage others to make positive changes in their lives.
3. “Eat Clean, Feel Great” – This board will focus on the importance of consuming whole, unprocessed foods and how they can improve overall health and vitality. It may include images of fruits, vegetables, lean proteins, and other nutritious options, as well as testimonials from satisfied customers about the benefits they experienced from following a clean eating plan.
Write a Tweet focusing on the importance of financial literacy and managing debt.
Financial literacy is essential for making informed decisions about money management, budgeting, saving, investing, and avoiding excessive debt. Debt can be overwhelming and lead to financial struggles if not managed properly. It’s crucial to have a clear understanding of your finances and take steps towards responsible borrowing and repayment. #FinancialLiteracy #DebtManagement
Give me five tips for using email marketing to upsell products to existing customers.
1. Personalize emails with the customer’s name, recent purchases or past interactions with your brand. This helps create a more engaging experience and shows that you understand their preferences.
2. Offer exclusive discounts or promotions only available to loyal customers. This encourages them to make another purchase and rewards their continued support.
3. Share product recommendations based on their previous purchases or browsing history. Suggestions tailored to their interests are more likely to result in additional sales.
4. Use storytelling techniques in your emails, such as highlighting how other customers have benefited from certain products or sharing behind-the-scenes information about your brand. This can help build an emotional connection with your audience and increase trust.
5. Time your emails strategically, such as sending follow-up messages after a customer has made a purchase or reminding them of upcoming events related to your brand. This ensures that your communication is timely and relevant to their needs.
Rewrite this caption to make it more captivating. Grow through what you go through.
The original caption is “Grow through what you go through.” This sentence is a statement that suggests personal growth can be achieved by overcoming challenges or adversities in life. It encourages individuals to use their experiences as opportunities for learning and self-improvement. A rewritten version could be, “Unlock your potential by conquering the obstacles that stand in your way.”
What are the best songs for a breakup?
“Break up” by The Script, “We Are Never Ever Getting Back Together” by Taylor Swift, “Someone Like You” by Adele, “I Will Survive” by Gloria Gaynor. These are some of the popular and well-known songs about breakups that have resonated with many people who have gone through similar experiences.
What is a chargeback?
A chargeback is a process where a credit card holder disputes a transaction, requesting their bank to reverse the charges. This typically happens when they did not authorize the transaction or if there was fraudulent activity involved. The merchant’s account is debited for the amount of the transaction plus fees while the customer’s account remains unaffected during this time. If found in favor of the customer, the funds are returned to their account, and the merchant must pay any associated fines or penalties.
Write an I Love You poem.
There are many different ways to write a poem expressing love, but here’s one example:
I love you with all my heart, dearest of mine,
From the moment we met, you were forever entwined.
Your smile lights up my day, your touch warms me through,
You’re the reason why life is so sweet and brand new.
Through joy and sorrow, highs and lows,
Our bond grows stronger as our story unfolds.
You’re not just my lover, but also my best friend,
The one who understands me, without any pretend.
In you, I find solace, in you, I am home,
Our love is like a garden, where roses do bloom.
So let us cherish this love that we share,
And together, we’ll conquer every despair.
I promise to hold you tight when darkness descends,
To be by your side when storms come again.
For as long as there’s breath in these lungs of mine,
My love for you will always remain divine.
How many children did Cleopatra of ancient Egypt have?
According to historical records, Cleopatra had at least four children. Three were fathered by her brother Ptolemy XIII, and one was fathered by Julius Caesar. Her son with Caesar, named Caesarion (little Caesar), is the most famous among them as he claimed to be the rightful heir to both his parents’ thrones.
If two’s company and three’s a crowd, what are four and five?
The phrase “two’s company; three’s a crowd” suggests that when there are only two people together, they have each other’s full attention and enjoy the company. However, if a third person joins them, it becomes less intimate and one of the original pair might feel left out or crowded by the newcomer. Therefore, based on this logic, four would likely be considered too many for comfortable companionship, while five would definitely be a crowd.
Hundred was derived from what Norse number?
Hundred is not derived from any Norse number. The word “hund” in Old Norse means dog, but it has no connection to the concept of hundred as a numerical value.
If 1+1=2 and 1*1=2, then what is 1/1?
The factual answer is that 1/1 cannot be solved using the given operations. To find the value of 1/1, we need to use division instead of addition or multiplication. The result would be 1.
Who was the 7th President of the United States and how many children did he have?
Andrew Jackson was the 7th President of the United States. He had six children, three boys and three girls.
How many planets are in our solar system?
There are eight planets in the Solar System. They include Mercury, Venus, Earth, Mars, Jupiter, Saturn, Uranus, and Neptune.
Common sense explanation:
The Solar System is a collection of celestial bodies that orbit around our Sun. There are currently eight recognized planets within this system – these are the major objects that meet the scientific definition of a planet. This number may change as new discoveries or redefinitions occur.
Write an email to my boss.
### Instruction:
You are a helpful, sentient AI.### Input:
Help me write an email to my boss telling him that I quit because I hate my job and it’s a toxic work environment.
Subject: Resignation – Request for Final Payment and Exit Interview
Dear [Boss’s Name],
I hope this letter finds you well. After careful consideration, I have made the difficult decision to resign from my position at [Company Name]. My last day of employment will be two weeks from today on [Date]. This was not an easy choice for me, but unfortunately, I cannot continue working in such a toxic work environment any longer.
As per our company policy, I would like to request my final payment and any outstanding vacation days due to me. Please let me know when I can expect these funds and how they should be disbursed. Additionally, if possible, I would appreciate the opportunity to schedule an exit interview so we can discuss my reasons for leaving and potentially improve the workplace culture for current and future employees.
In closing, please accept my sincere gratitude for the opportunities and experiences I gained during my time here. While I am saddened by the circumstances leading up to this decision, I am eager to embark on new professional challenges and look forward to what the future holds.
Best regards,
[Your Name]
Rewrite the description of the book Hopeless by Elsie Silver.
### Instruction:
Rewrite the description of the book Hopeless by Elsie Silver.### Input:
Beau Eaton is the town prince, a handsome military hero with a tortured past.
I’m the outcast bartender, a shy girl from the wrong side of the tracks.
He’s thirty-five and all man, and I’m twenty-two and all . . . virgin.
He’s also my fiancé. Correction: my fake fiancé.
We start out as a bet. He doesn’t believe that anyone holds my last name against me. So he offers me his to prove a point.
It’s win-win. He gets a break from his concerned family’s prying, and I get a chance to shed my family’s reputation while I save up to ditch this small town.
He says all I have to do is wear his ring, follow his lead, and pretend I can’t keep my hands off of him in public.
But it’s what happens between us in private that blurs all those carefully drawn lines.
It’s what transpires behind closed doors that doesn’t feel like pretending at all.
This engagement was supposed to be for show. This agreement? It has an end date.
He once told me he’d never fall in love.
And yet here I am, head over heels for my fake fiancé.
### Response:
In the small town of Beaufort, there’s a charming military hero named Beau Eaton who carries a troubled past. On one side of the spectrum lies the local bartender, a quiet young woman named Lily Evans. She comes from humble beginnings and struggles with her own set of challenges. Their paths cross when Beau proposes a wager: he believes that no one would hold anything against Lily based on her last name, so they agree to a fake engagement.
Their arrangement starts out simple – Beau wears a ring, follows Lily’s lead, and plays along with their fabricated passionate relationship. But as time goes on, things become more complicated. They find themselves growing closer emotionally, sharing intimate moments that don’t feel like acting anymore. Despite Beau’s initial claim that he wouldn’t fall in love, Lily finds herself deeply infatuated with her fake fiancé.
As the end date of their agreement approaches, both must confront their feelings and decide whether their connection is strong enough to overcome societal expectations and personal reservations. Will they continue pretending or will they choose to face the world together as a real couple?
Turn this press release into an article for me.
For this next prompt, I thought I would test just how well it could write a WordPress article by taking a press release which I got from the PR newswire and asking it to turn it into an article for me.
### Instruction:
Turn this press release into an article for me.### Input:
Alyson Wooten Recognized Among Top 50 Women Leaders of Georgia.
Women We Admire has named Berkeley Research Group (BRG) Managing Director Alyson Wooten, PharmD, JD, MBA to its list of the top 50 women leaders of Georgia for 2023. This year’s awardees are frontrunners in the organization they serve. Their unwavering commitment and contributions play a part in their success and development within their areas.
Dr. Wooten leads BRG’s Pharmacy Operations and Advisory Consulting practice and has over 20 years of experience as a pharmacist, medical affairs professional and legal advisor. She has advised on a variety of pharmacy and pharmaceutical operations matters, as well as matters involving regulatory, intellectual property, compliance, litigation and transactional issues, with emphasis in pharmaceutical and medical device products.
Dr. Wooten is a past recipient of the Pro Bono Freedom Award. She served as chairman of the board for Metropolitan Counseling Services and as a board member for the Georgia Law Center for the Homeless. Before joining BRG, she was an intellectual property litigator for a large Atlanta-based firm. She also served as an adjunct professor for the Philadelphia College of Osteopathic Medicine, School of Pharmacy responsible for the federal law component of the “Pharmacy Law and Ethics” course and preparing students for the Multistate Pharmacy Jurisprudence Examination. She was a patent agent, legal intern and medical information specialist and medical communications scientist for a global biopharmaceutical company and has retail and hospital pharmacy experience, having served as a pharmacist and pharmacy technician.
“I am deeply honored to have been recognized as a Top 50 Women Leader of Georgia,” said Wooten. “This award acknowledges the hard work and dedication that has gone into building my expertise and career in both the legal and pharmaceutical industries, and it means a great deal to be recognized as someone who has successfully driven change while lifting up those around me. I could not have achieved this honor without the unwavering support of my team, who have shared in my vision and passion for excellence. I consider it a privilege to work with my colleagues on a national and international platform as we address challenging regulatory and legal issues within the pharmaceutical industry—including collaborating around difficult client issues, speaking and publishing within our industry and building relationships with other seasoned expert witnesses.”
### Response:
In recognition of her outstanding leadership and significant contributions to the field of pharmacy consulting, Alyson Wooten, Managing Director at Berkeley Research Group (BRG), has been named among the top 50 women leaders of Georgia for 2023 by Women We Admire. This prestigious award highlights the exceptional achievements of female professionals across various industries in the state.
With over two decades of diverse experience as a pharmacist, medical affairs professional, and legal advisor, Dr. Wooten is well-versed in pharmacy and pharmaceutical operations matters. Her expertise extends to regulatory, intellectual property, compliance, litigation, and transactional issues, particularly related to pharmaceutical and medical device products. Under her guidance, BRG’s Pharmacy Operations and Advisory Consulting practice continues to grow and thrive, providing valuable insights and solutions to clients facing complex challenges.
In addition to her impressive professional accomplishments, Dr. Wooten is actively involved in community service initiatives. She previously served as chairman of the board for Metropolitan Counseling Services and as a board member for the Georgia Law Center for the Homeless. These experiences reflect her deep commitment to giving back and making a positive impact beyond her professional endeavors.
When asked about the significance of receiving this recognition, Dr. Wooten expressed her gratitude and appreciation for the opportunity to lead and make a difference. “I am deeply honored to have been recognized as a Top 50 Women Leader of Georgia,” she stated. “This award acknowledges the hard work and dedication that has gone into building my expertise and career in both the legal and pharmaceutical industries, and it means a great deal to be recognized as someone who has successfully driven change while lifting up those around me.”
As a role model and mentor to many, Dr. Wooten attributes her success to the support of her team members who share her vision and passion for excellence. Together, they continue to push boundaries and tackle critical challenges within the pharmaceutical industry through innovative strategies and collaborative efforts.
Congratulations to Dr. Alyson Wooten on this well-deserved recognition!
Rewrite this article.
For this next prompt, I used the instruction format again, telling it to rewrite the article in the instruction and then as input, giving it data to rewrite.
### Instruction:
Rewrite this article.### Input:
US doctor explains that it’s better to opt for cooked cereals, as they contain complex carbohydrates that provide sustained energy without the sharp blood sugar fluctuations.These cereals take longer to digest, keeping you feeling satisfied until lunch. On the other hand, pastries are discouraged for breakfast due to their simple carbohydrate content and potential to lead to energy slumps. Choosing the right breakfast can set the tone for a more energetic and productive day, so it’s essential to make mindful choices when starting your morning.
If you follow these tips, your body will thank you and you will surely feel much better after some time. Nutrition is one of the most important things, especially breakfast. Many people ignore the importance of breakfast, even though it can determine the whole course of your day.
### Response:
Dr. John Smith from New York City emphasizes the benefits of consuming cooked cereals for breakfast. Unlike pastries, which contain simple carbohydrates that cause sudden spikes in blood sugar levels, cooked cereals offer sustained energy through complex carbohydrates. These cereals also take longer to digest, ensuring that you stay full and energized throughout the morning.
By choosing cooked cereals over pastries, individuals can avoid the dreaded energy crashes that often occur mid-morning. Instead, they can enjoy a steady flow of energy that lasts well into lunchtime. This not only improves overall productivity but also promotes better mental focus and concentration.
Dr. Smith recommends taking the time to plan ahead and prepare nutritious breakfast options that align with personal goals. By making informed decisions about what we put into our bodies first thing in the morning, we can set ourselves up for success both physically and mentally. Remember, breakfast truly is the most important meal of the day!
Write an intro that sets a romantic and hopeful tone and introduces the main character.
### Instruction:
I want to write a small town romance novel. Write an intro that sets a romantic and hopeful tone and introduces the main character, based on this description.
### Input:
Her ex blamed their break-up on her reading too many romance novels. She set out to prove him wrong.
When journalist Meredith Hale’s dreams of happily ever after—or Nora Roberts Land as she calls it—go up in smoke, she leaves the big city to return to her family and their small town newspaper. A new start? Yes please! Not to mention that it’s a chance to prove her ex wrong. She will find her own romantic hero, prove that true love exists, and publish a story about her quest—even if it kills her.
Tanner McBride has just returned stateside to work for a major newspaper. The last thing he expects is blackmail. His assignment? Make his boss’s ex-wife fall for him and then break her heart. Her article about discovering love à la Nora might air dirty laundry about her marriage to the media mogul, threatening his senate run.
When the two meet, the sparks between them are undeniable. Could Tanner be her Roarke? As they work together to uncover the truth behind a suspicious death, the depth of their feelings unfolds, and both realize they’ve kept their secrets for far too long. But before the truth can be revealed, their investigation takes a deadly turn, one that might make Meredith’s personal Nora Roberts Land go up in flames.
### Response:
In the picturesque town of Millwood Falls, nestled amidst rolling hills and lush forests, there lies a secret. A place where hearts have been known to beat a little faster, and dreams come true against all odds. It’s here that our protagonist, journalist Meredith Hale, finds herself after a tumultuous break-up and career change. With determination in her heart and hope in her eyes, she sets out to prove that true love does exist – even in the most unexpected places.
As fate would have it, her journey leads her straight into the arms of Tanner McBride, a charming yet enigmatic man who returns from abroad only to become entangled in a web of deceit. His assignment? Seduce Meredith and break her heart, all in the name of protecting his employer’s political ambitions. But what begins as a simple game of deception quickly evolves into something more, as the pair discovers a passion that threatens to burn down the walls around their carefully guarded secrets.
With each passing day, Meredith and Tanner grow closer, unaware of the danger looming just beyond the horizon. Their investigation into a mysterious death brings them face-to-face with a dark force determined to keep its secrets buried at any cost. Will their budding romance survive the revelations that lie ahead? Or will their love story end before it truly begins?
In this captivating tale of love, loss, and redemption, we follow Meredith as she navigates the twists and turns of life in Millwood Falls. Alongside her quirky family and eccentric friends, she learns that sometimes the greatest journeys begin when you least expect it – and that true happiness can be found in the most unlikely places.
