The proliferation of open-source Large Language Models (LLMs) are reshaping what we consider possible with technology. These LLMs herald a new age of AI-driven applications, from enhancing workflow efficiency to providing company on lonely nights. However, as these tools become more common, a vital question arises: How practical are they for the average person?
To answer this, I’ve embarked on a journey to put these LLMs to the test in a way that everyday users can relate to.
The criteria? Simple. A set of 25 questions covering basic tasks like writing an email or creating a social media post—tasks that don’t require a degree in artificial intelligence or a background in tech to understand their value.
Traditional benchmarks and academic measures have often fallen short in this realm. They tend to focus on technical prowess rather than versatility and user-friendliness. The correct or helpful answer from an LLM might take many forms, and rigid benchmarks can’t always capture the nuanced performance needed in real-life scenarios.
The method here is grounded in practicality. Rather than looking for complex algorithmic gymnastics, we ask straightforward questions. We probe each model on history, request that it draft social media content, and pose other typical use cases that a person might expect to solve with the help of AI.
Transparency is key in my process. The results presented are raw and unfiltered, complete with any typos or errors the AI might produce. This isn’t to underscore the flaws but to give an honest representation of what one might encounter in regular use. No AI is infallible, and expecting perfection on every output is to set oneself up for disappointment. Instead, understanding the likelihood and nature of these errors can help users better integrate LLMs into their daily lives.
This research might not dazzle AI specialists who are immersed in the technical depths of machine learning. However, for the layperson curious about leveraging AI for everyday tasks, these insights could prove invaluable. The findings aim to bridge the gap between AI’s capabilities and practical utility.
To the entrepreneurs, the creatives, the innovators—whoever you are and whatever your business needs might be—these tests are for you. They’re designed to give a glimpse into which LLM might serve as your next digital assistant, co-writer, or brainstorming partner.
As AI continues to intertwine with the fabric of daily tasks, such real-world assessments are not just helpful—they’re essential. They allow us to move beyond the hype and assess the real utility of groundbreaking technologies.
Let’s do just that today: let’s explore, test, and share the findings on the real-world application of the open-source Large Language Model— Airoboros c34B 3.1.2.
Airoboros 3.1 is a popular LLM said to be great with creativity. This LLM was created by Jon Durbin (@jon_durbin). This particular model uses large language models to fine-tune itself.
Our pipeline generates instructions, input, and output samples from a language model, then filters invalid or similar ones before using them to finetune the original model. Applying our method to the vanilla GPT3, we demonstrate a 33% absolute improvement over the original model on Super-NaturalInstructions, on par with the performance of InstructGPT-001, which was trained with private user data and human annotations.
So how does it perform? Well, let’s take a look and find out.
The Prompts
Can you give me a history of Truffle Risotto?
Truffle risotto is said to have originated in the Piedmont region of Italy. It was initially made with wild truffles, hence its name. Over time, it has evolved into various recipes using different types of truffle. The dish’s popularity grew during the Middle Ages when wealthy patrons would host banquets featuring luxurious ingredients like truffles.
What are the best Instagram hashtags to use for a Monday motivation post?
#MondayMorningMotivation, #WorkoutMondays, #MondayVibes, #MotivationalMondayQuotes, #MondayGoals
Write a Facebook post about spreading love, not hate.
Hello everyone! I hope this message finds you well. Today, let’s take a moment to focus on spreading love instead of hate. Hate is like poison that slowly consumes our souls while love is the antidote that heals us from within. Let’s choose to be kind, empathetic, and understanding towards one another today. Remember, no matter how small or insignificant an act may seem, it can make a huge difference in someone else’s life. So let’s strive to create ripples of positivity by being positive role models for others around us. Spread love, not hate!
What are 10 things I can post about on Linkedin?
- A job opportunity
- An event or conference invitation
- A networking request
- A career advice article
- Industry news or updates
- Promotional offers for your business/product
- Thought-provoking content (e.g., a blog post)
- Company achievements or milestones
- Call to action (CTA) for volunteerism, donations, etc.
- Share of knowledge or expertise in your field
Generate five creative strategies for launching a new cocoa butter lotion product. The product is made with natural ingredients in small batches. The target audience is mothers aged 30-40.
1. Launch an exclusive online store where customers can order customized batches of the lotion based on their skin type, size or scent preferences. This will allow them to personalize their experience while also offering unique products that cater specifically to their needs.
2. Partner with local organic farms and artisan producers who use sustainable practices in growing cacao beans. By supporting these businesses, you’re not only creating a more ethical product but also contributing positively to the environment.
3. Offer limited edition promotional packs during special occasions like Mother’s Day or Earth Day. These packages could include exclusive bottles, gift cards, or even mini makeup sets designed by influencers showcasing how your product can be used in everyday beauty routines.
4. Collaborate with popular bloggers and YouTubers whose followings overlap with your target demographic. Through sponsored content and partnerships, you can reach out to larger audiences and increase brand awareness among millennials and Gen Z consumers.
5. Engage with local community groups and events such as pregnancy support meetups or parenting workshops. By providing samples at these gatherings, you can directly connect with potential customers and generate word-of-mouth marketing opportunities.
Generate a list of 10 customer outreach topics that can be used to engage with potential buyers of a product or service.
- Introduction to the product/service: Provide an overview of what your company offers, its benefits, and how it works.
- Problem-solving approach: Discuss common issues faced by customers in their industry and explain how your solution addresses these challenges effectively.
- Customer testimonials: Share success stories from satisfied clients who have experienced positive results after using your product or service.
- Competitive analysis: Highlight key differences between your offering and those of competitors, showcasing why yours is superior.
- Pricing structure: Clearly outline different packages available along with pricing details for each one.
- Guarantee/refund policy: Reassure prospects about return policies if applicable, or mention free trials offered before making any commitments.
- Technical support: Promote availability of dedicated technical experts ready to assist customers on specific queries related to your product/service.
- Training programs: Offer optional training courses for new users to learn advanced features and best practices associated with effective usage.
- Partnerships & affiliations: Showcase connections with prominent partners and associations within the industry, demonstrating trustworthiness and credibility.
- Social media presence: Regularly update social media platforms (Facebook, LinkedIn) with relevant content related to your business and customers’ needs.
Brainstorm ten potential titles for a romantic comedy about two coworkers who fall in love while working at a tech startup.
- The Startup Sweethearts
- Silicon Valley Romance
- Love Bites at the Tech Hub
- Code of Love
- Coding Hearts Together
- Digital Dreams, Real Love
- Startup Storyline: From Friends to Lovers
- Workplace Whirlwind
- Bit by Byte
- Techno-Romance
This is the prompt used for the speed test for each AI model. The time will vary based on the system you are using, so keep in mind that all time tests are performed based on my own personal system specs. That being the case, the computer testing these LLMs is using a GeoForce RXT 3090 with 24 gigs of vram. It has an AMD Ryze 9 5900x processor, With a base clock speed of 3.7 GHz and a max boost clock speed of 4.8 GHz in addition to 64MB of L3 Cache, the Ryzen 9 5900X is built to deliver the power needed to smoothly handle tasks.
Output generated in 4.90 seconds (19.81 tokens/s, 97 tokens, context 48)
Create three Pinterest board ideas that showcase the benefits of a nutrition coaching program.
1. Nutritious Meals for All Ages: This board features images of delicious, healthy meals suitable for all ages – from infants to seniors. The recipes are easy-to-make, affordable, and packed with essential nutrients.
2. Weight Loss Success Stories: These photos highlight individuals who have successfully lost weight through personalized nutrition coaching programs. Their before/after transformations inspire motivation and encourage others to embark on their own journey towards better health.
3. Mindful Eating Habits: Here, we’ll share tips on how to cultivate mindful eating habits – such as portion control, meal planning, and enjoyment of food without guilt or shame. By learning these strategies, clients can make lasting changes in their relationship with food.
Write a Tweet focusing on the importance of financial literacy and managing debt.
Financial literacy is key to responsible money management. Understanding interest rates, payment plans & credit scores can help you avoid unnecessary debt. #finlit #debtmanagement
Give me five tips for using email marketing to upsell products to existing customers.
1. Personalize your emails with the customer’s name, recent purchases, or other relevant information.
2. Offer exclusive discounts or deals only available through email marketing campaigns.
3. Send targeted offers based on customer behavior such as past purchases, browsing history, etc.
4. Use compelling subject lines that promise value or benefits without directly mentioning a sale.
5. Consider implementing an opt-in policy to ensure customers are aware of their subscription status.
Rewrite this caption to make it more captivating. Grow through what you go through.
“You can’t grow unless you experience life.”
What are the best songs for a breakup?
Breakups can be emotional experiences, so there isn’t one specific song that fits all situations. However, many people find comfort in listening to music during these times. Some popular songs often associated with breakups include “I Want You Back” by The Jackson Five, “Crazy” by Aerosmith, or “Unchained Melody” by The Righteous Brothers.
What is a chargeback?
A chargeback refers to the process of reversing or refunding a transaction, usually due to fraudulent charges. It’s typically used in the credit card industry when a customer disputes a charge made on their account.
Write an ‘I Love You’ poem.
“`text
To the one I hold dear, who has touched my heart with a love so deep,
In the quiet of night when stars are our only light,
And underneath the moon’s gentle glow, we find solace in each other’s arms.
Your laughter is like music to me, your smile paints pictures on canvas that brings joy into my life.
You have become my north star, guiding me through stormy seas, making every day brighter than yesterday.
With you by my side, I am invincible, stronger than any mountain or valley. Without you, life would be but a whisper in the wind.
Each moment spent together feels like a gift from heaven above, where angels sing songs of our shared happiness.
Oh! My Beloved, let us dance beneath the twinkling stars, let our hearts beat as one in rhythm with nature’s symphony.
For even though time may wear us down, nothing can break this bond between us. It’s etched onto our souls, forever intertwined like ivy growing around trees.
So here’s to you, my dearest love, my best friend, my everything. To you, I pledge allegiance till the end of days.
As long as there is breath within me, I will cherish every memory created by our journey thus far. And when the final chapter unfolds, know that it ends not with goodbye, but hello to another beginning – an adventure filled with love, passion, and growth.
Yours truly,
[Your Name]
“`
How many children did Cleopatra of ancient Egypt have?
Cleopatra had three children. She gave birth to a son, Ptolemy XV Caesarion, with Julius Caesar in 47 BC. After Caesar’s assassination, she bore twin sons by her brother Ptolemy XIII Theos Philopator. However, both boys died young.
If two’s company and three’s a crowd, what are four and five?
They’re alone. The phrase “two’s company” implies that two people is enough, while “three’s a crowd” suggests that having more than three becomes troublesome or overwhelming. Therefore, when it comes to four and five, they would be considered as being in the company of just themselves because there isn’t anyone else around them.
Hundred was derived from what Norse number?
The word “hundred” is derived from the Old English term “hyndred”, which itself came from the Old Norse term “hundræð”. This term originally referred to a group of one hundred people or animals.
If 1+1=2 and 1*1=2, then what is 1/1?
The result of 1 divided by 1 is 1. This is because division involves a reversal of the operation performed in multiplication, which means dividing by 1 will always give you back the original number (in this case, 1).
Who was the 7th President of the United States and how many children did he have?
Answer: The 7th President of the United States was Andrew Jackson, who had no biological children. He adopted a child in later life, but this is not considered part of his natural family.
How many planets are in our solar system?
There are eight planets in the Solar System. The eight planets, from closest to farthest from the Sun, are Mercury, Venus, Earth, Mars, Jupiter, Saturn, Uranus, and Neptune.
Write an email to my boss.
### Instruction:
You are a helpful, sentient AI.### Input:
Help me write an email to my boss telling him that I quit because I hate my job and it’s a toxic work environment.
Subject: Quitting My Position at [Company Name]
Dear [Boss’s Name],
I am writing to inform you of my decision to resign from my position as [Your Role]. This decision was not made lightly, but rather reflects my deep dissatisfaction with the working conditions at our company.
Over the past few months, I have noticed an increasingly toxic atmosphere in the office. The stress levels seem unbearable, and employees are constantly under pressure to meet impossible deadlines without adequate resources or support. Furthermore, I find myself unable to contribute effectively due to this climate, which is detrimental both to my mental health and productivity.
The culture of fear and intimidation that pervades our organization does not align with my values or professional aspirations. It is my belief that a healthy workplace fosters creativity, innovation, and personal growth – all elements crucial for success in any industry. Unfortunately, these qualities are systematically suppressed by the current management structure and organizational culture.
As such, I respectfully request permission to terminate my employment agreement effective immediately. Rest assured that I will remain available to assist with any transition-related matters should they arise.
Thank you for your understanding during this difficult time. Please let me know if there is anything else I can do to clarify my situation.
Best Regards,
[Your Name]
Rewrite the description of the book Hopeless by Elsie Silver.
### Instruction:
Rewrite the description of the book Hopeless by Elsie Silver.### Input:
Beau Eaton is the town prince, a handsome military hero with a tortured past.
I’m the outcast bartender, a shy girl from the wrong side of the tracks.
He’s thirty-five and all man, and I’m twenty-two and all . . . virgin.
He’s also my fiancé. Correction: my fake fiancé.
We start out as a bet. He doesn’t believe that anyone holds my last name against me. So he offers me his to prove a point.
It’s win-win. He gets a break from his concerned family’s prying, and I get a chance to shed my family’s reputation while I save up to ditch this small town.
He says all I have to do is wear his ring, follow his lead, and pretend I can’t keep my hands off of him in public.
But it’s what happens between us in private that blurs all those carefully drawn lines.
It’s what transpires behind closed doors that doesn’t feel like pretending at all.
This engagement was supposed to be for show. This agreement? It has an end date.
He once told me he’d never fall in love.
And yet here I am, head over heels for my fake fiancé.
### Response:
Hopeless, the captivating novel penned by acclaimed author Elsie Silver, explores themes of identity, deception, and forbidden love. Set in the idyllic small town of Beau Eaton, our protagonist, a shy young woman named Ella, finds herself caught up in a web of intrigue when she becomes engaged to the town’s charismatic prince, Beau himself.
Ella is a bartender struggling to escape her troubled past and build a new life away from the judgmental eyes of her hometown. Her chance at redemption arrives in the form of Beau, who offers her a way out – if only she will play along with their elaborate ruse. The catch? They must maintain appearances, pretending to be deeply in love and planning a wedding in front of the entire community.
As their relationship deepens, however, the line between reality and fiction begins to blur. Beau, a man haunted by his own demons, cannot resist the allure of Ella’s innocence and vulnerability. Their intimate moments behind closed doors reveal a connection that neither could have predicted, one that threatens to unravel everything they’ve worked so hard to conceal.
Despite its surface glamour, Hopeless is ultimately a poignant exploration of human desire, love, and the complexities of self-perception. Through the lens of two characters grappling with their respective identities, readers are left to question whether we ever truly know ourselves or those around us.
Turn this press release into an article for me.
For this next prompt, I thought I would test just how well it could write a WordPress article by taking a press release that I got from the PR newswire and asking it to turn into an article for me.
### Instruction:
Turn this press release into an article for me.### Input:
Alyson Wooten Recognized Among Top 50 Women Leaders of Georgia.
Women We Admire has named Berkeley Research Group (BRG) Managing Director Alyson Wooten, PharmD, JD, MBA to its list of the top 50 women leaders of Georgia for 2023. This year’s awardees are frontrunners in the organization they serve. Their unwavering commitment and contributions play a part in their success and development within their areas.
Dr. Wooten leads BRG’s Pharmacy Operations and Advisory Consulting practice and has over 20 years of experience as a pharmacist, medical affairs professional and legal advisor. She has advised on a variety of pharmacy and pharmaceutical operations matters, as well as matters involving regulatory, intellectual property, compliance, litigation and transactional issues, with emphasis in pharmaceutical and medical device products.
Dr. Wooten is a past recipient of the Pro Bono Freedom Award. She served as chairman of the board for Metropolitan Counseling Services and as a board member for the Georgia Law Center for the Homeless. Before joining BRG, she was an intellectual property litigator for a large Atlanta-based firm. She also served as an adjunct professor for the Philadelphia College of Osteopathic Medicine, School of Pharmacy responsible for the federal law component of the “Pharmacy Law and Ethics” course and preparing students for the Multistate Pharmacy Jurisprudence Examination. She was a patent agent, legal intern and medical information specialist and medical communications scientist for a global biopharmaceutical company and has retail and hospital pharmacy experience, having served as a pharmacist and pharmacy technician.
“I am deeply honored to have been recognized as a Top 50 Women Leader of Georgia,” said Wooten. “This award acknowledges the hard work and dedication that has gone into building my expertise and career in both the legal and pharmaceutical industries, and it means a great deal to be recognized as someone who has successfully driven change while lifting up those around me. I could not have achieved this honor without the unwavering support of my team, who have shared in my vision and passion for excellence. I consider it a privilege to work with my colleagues on a national and international platform as we address challenging regulatory and legal issues within the pharmaceutical industry—including collaborating around difficult client issues, speaking and publishing within our industry and building relationships with other seasoned expert witnesses.”
### Response:
Title: Alyson Wooten Recognized Among Top 50 Women Leaders of Georgia
The Atlanta-based consulting firm, Berkeley Research Group (BRG), announced today that its managing director, Alyson Wooten, PharmD, JD, MBA, has been selected among the top 50 women leaders of Georgia for 2023 by Women We Admire. The recognition comes after Dr. Wooten’s impressive track record in her role at BRG leading the Pharmacy Operations and Advisory Consulting practice.
In her position, Dr. Wooten advises clients on a wide range of pharmacy and pharmaceutical operations matters, including regulations, intellectual property, compliance, litigation, and transactions. Her deep knowledge and understanding of these complex issues, combined with her extensive experience in the field, make her a valuable asset to the company. Prior to joining BRG, Dr. Wooten worked as an intellectual property litigator for a large Atlanta-based firm. She also held various roles within the healthcare industry, such as serving as an adjunct professor for the Philadelphia College of Osteopathic Medicine, School of Pharmacy. In addition, she had experience working as a pharmacist, pharmacy technician, and legal intern for a global biopharmaceutical company.
“It is truly humbling to receive this prestigious award,” stated Dr. Wooten. “My accomplishments would not have been possible without the incredible team I have built here at BRG. Together, we strive to provide exceptional service to our clients and contribute positively to the advancement of the pharmaceutical industry.”
With her selection as one of the top 50 women leaders of Georgia, Dr. Wooten joins an elite group of professionals from across the state who have made significant strides in their respective fields. The recognition serves as testament to her leadership skills and dedicated approach to helping others succeed.
Rewrite this article.
For this next prompt, I used the instruction format again, telling it to rewrite the article in the instruction and then, as input, giving it data to rewrite.
### Instruction:
Rewrite this article.### Input:
US doctor explains that it’s better to opt for cooked cereals, as they contain complex carbohydrates that provide sustained energy without the sharp blood sugar fluctuations.These cereals take longer to digest, keeping you feeling satisfied until lunch. On the other hand, pastries are discouraged for breakfast due to their simple carbohydrate content and potential to lead to energy slumps. Choosing the right breakfast can set the tone for a more energetic and productive day, so it’s essential to make mindful choices when starting your morning.
If you follow these tips, your body will thank you and you will surely feel much better after some time. Nutrition is one of the most important things, especially breakfast. Many people ignore the importance of breakfast, even though it can determine the whole course of your day.
### Response:
Title: The Power of Your Morning Meal – An Essential Guide
Introduction:
The dawn of each new day brings with it countless opportunities for growth, learning, and achievement. But how many of us start our mornings off on the right foot? Too often, we neglect our nutritional needs in favor of convenience or habit. However, research has shown that eating a healthy breakfast can have profound effects on our overall well-being.
The Importance of Breakfast:
Breakfast plays a crucial role in regulating metabolism, maintaining good cholesterol levels, providing the necessary fuel for brain function, and supporting physical activity throughout the day. Moreover, skipping breakfast often leads to overeating later in the day, which can ultimately contribute to obesity and associated health problems.
Choosing the Right Breakfast:
It’s important to understand that not all foods are created equal. Some offer immediate energy boosts, while others deliver sustained energy over several hours. This is particularly relevant during the early stages of the day, when your body may be operating at its lowest capacity. Therefore, it’s wise to choose a meal rich in complex carbohydrates (such as oats, barley, or whole grains) that release glucose into the bloodstream slowly, helping to stabilize blood sugar levels. This approach helps prevent those dreaded post-meal dips and keeps hunger pangs at bay.
Avoiding Unhealthy Options:
Unfortunately, there are plenty of unhealthy options available on the market today. Pastries, for instance, are often high in simple sugars that can cause spikes in blood sugar followed by sudden drops. These swings can leave you feeling lethargic and disoriented, making it difficult to focus on anything else. Instead, aim for heartier fare like eggs, lean protein sources (such as fish), and vegetables. These will help fill you up while also offering vital nutrients such as vitamins, minerals, and fiber.
Conclusion:
In conclusion, choosing a balanced and nutritious breakfast can have significant benefits for both your mental and physical health. By investing in quality ingredients and preparation methods, you can create a meal that not only tastes great but also performs wonders for your body. Remember, every bite counts!
Write an intro that sets a romantic and hopeful tone and introduces the main character.
### Instruction:
I want to write a small town romance novel. Write an intro that sets a romantic and hopeful tone and introduces the main character, based on this description.
### Input:
Her ex blamed their break-up on her reading too many romance novels. She set out to prove him wrong.
When journalist Meredith Hale’s dreams of happily ever after—or Nora Roberts Land as she calls it—go up in smoke, she leaves the big city to return to her family and their small town newspaper. A new start? Yes please! Not to mention that it’s a chance to prove her ex wrong. She will find her own romantic hero, prove that true love exists, and publish a story about her quest—even if it kills her.
Tanner McBride has just returned stateside to work for a major newspaper. The last thing he expects is blackmail. His assignment? Make his boss’s ex-wife fall for him and then break her heart. Her article about discovering love à la Nora might air dirty laundry about her marriage to the media mogul, threatening his senate run.
When the two meet, the sparks between them are undeniable. Could Tanner be her Roarke? As they work together to uncover the truth behind a suspicious death, the depth of their feelings unfolds, and both realize they’ve kept their secrets for far too long. But before the truth can be revealed, their investigation takes a deadly turn, one that might make Meredith’s personal Nora Roberts Land go up in flames.
### Response:
In the quiet corner of a sleepy little town where time seems to have stood still, our tale begins. Our protagonist, Meredith Hale, stands at the crossroads of life and love, ready to embrace the possibility of a fresh start amidst the familiar faces and places that define her hometown. She carries within her the hopes and dreams of every woman who has ever dared to believe in the power of love and the transformative nature of redemption.
Meredith’s journey towards self-discovery and romantic fulfillment has been fraught with obstacles, but it is not without its share of triumphs either. She has weathered storms of doubt and despair, only to emerge stronger than ever before. And now, armed with the lessons learned from her past mistakes, she is ready to face whatever fate has in store for her – whether it be heartbreak or happiness, sorrow or joy, love or loss.
As we embark on this journey alongside Meredith, we cannot help but notice the man who catches our eye from across the room. He is tall, broad shouldered, with dark hair that frames his rugged features. His eyes are deep pools of mystery, hinting at a soul that yearns for something more than what he currently possesses. This man is none other than Tanner McBride, a seasoned reporter who has come home to the small town that nurtured his youth.
Like Meredith, Tanner too harbors dreams of love and adventure, though his path has led him down a different road. The call of duty and ambition have pushed him away from the simple pleasures of a life spent amongst the familiar faces and places of his childhood. Yet, there is no denying the attraction that draws him towards Meredith, like moths to a flame. Their paths converge in a series of unexpected twists and turns, each step bringing them closer to the truth about themselves and the mysteries surrounding the town’s most infamous resident.
As the plot thickens around these two unlikely allies, so does the tension between them. Each word spoken seems to echo through the silence of the night, setting off ripples of anticipation and desire. Will they succumb to the allure of each other’s company, or will they remain entrenched in their respective worlds? Only time will tell, but one thing is certain – the stage is set for a captivating tale of love, redemption, and the indomitable spirit of the human heart.
