About: Passionate Software Engineer
This is a submission for the Twilio Challenge
Xpenser is not just a simple expense manager. It is an advanced expense management tool designed to simplify logging and analyzing your spending habits. With robust features, including seamless WhatsApp integration powered by Twilio, Xpenser stands out as a unique solution for personal finance management.
Checkout the Demo on YouTube at:
Experience Xpenser live https://xpenser.amitwani.dev.
Explore the project on GitHub:
mtwn105
/
xpenser-whatsapp-bot
You can find Xpenser live here: https://xpenser.amitwani.dev.
Join the Twilio Sandbox WhatsApp Number: +14155238886 by sending join per-mud
Backend: NodeJS, Express
Frontend: Angular, Typescript
Database: MongoDB
Deployment: Docker, Northflank
AI: Gemini 1.5 Flash
Twilio: Verify, Functions, WhatsApp
To test the WhatsApp integration, join the Twilio Sandbox WhatsApp Number: +14155238886 by sending join per-mud
Users register on the web portal, verifying their phone numbers via OTP (Powered by Twilio Verify).
The dashboard offers detailed analytics, including AI-driven insights, category-wise distribution, and average spending.
Users can easily add, manage, and delete expenses. The AI automatically categorizes expenses upon saving.
Join the Twilio Sandbox WhatsApp Number: +14155238886 by sending join per-mud
Log new expenses effortlessly via WhatsApp. The AI interprets user messages to gather details for saving the expense.
Request insights on spending, such as top categories or average spending. The AI provides answers based on the last 100 expenses.
Backend: NodeJS, Express
Frontend: Angular, Typescript
Database: MongoDB
Deployment: Docker, Northflank
AI: Gemini 1.5 Flash
Twilio: Verify, Functions, WhatsApp
Xpenser leverages three Twilio services: Verify, Functions and WhatsApp Messaging
Verify
Twilio's Verify service sends OTPs for user authentication.
Send OTP
const verification = await client.verify.v2.services(otpServiceId)
.verifications
.create({ to: req.body.phonenumber, channel: 'sms' });
Verify OTP
const verification = await client.verify.v2.services(otpServiceId)
.verificationChecks
.create({ to: req.body.phonenumber, code: req.body.code })
Functions
Twilio Functions handles incoming WhatsApp messages, interfacing with the backend and Gemini AI.
Generated functions using
twilio serverless:init twilio --typescript
export const handler: ServerlessFunctionSignature = async function (
context: Context<MyContext>,
event: MyEvent,
callback: ServerlessCallback
) {
// Handle Incoming Message
}
WhatsApp Messaging
Twilio's Programmable WhatsApp Messaging facilitates user interaction through WhatsApp.
Send WhatsApp Message using TwiML
const twiml = new Twilio.twiml.MessagingResponse();
twiml.message("Please ask about spends you have done or spend you want to log.");
callback(null, twiml);
Gemini 1.5 Flash, a Google AI Model, enhances Xpenser with advanced analytics and predictions.
Expense Analytics
Analyzing user expense history to provide insights and respond to user queries.
const analyticsModel = genAI.getGenerativeModel({
model: "gemini-1.5-flash",
systemInstruction: "Based on below expenses done by user give answer to user. Optimize as WhatsApp message reply and add emojis.\n\nExpense History:\n" + expenseCsvText,
});
const generationConfig = {
temperature: 0.6,
topP: 0.95,
topK: 64,
maxOutputTokens: 8192,
responseMimeType: "application/json",
};
const chatSession = model.startChat({
generationConfig
});
const result = await chatSession.sendMessage(event.Body);
const aiResponse = result.response.text()
Expense Categorization
Categorizing expenses based on user-provided descriptions.
const analyticsModel = genAI.getGenerativeModel({
model: "gemini-1.5-flash",
systemInstruction: "detect the category and subcategory from below\n1. Housing - Rent, Taxes, Insurance, Utilities, Repairs, Improvement, Fees\n2. Transportation - Payments, Fuel, Insurance, Repairs, Public, Parking, Tolls, Licensing\n3. Food - Groceries, Dining, Coffee, Delivery, Snacks, etc.",
});
const generationConfig = {
temperature: 0.6,
topP: 0.95,
topK: 64,
maxOutputTokens: 8192,
responseMimeType: "application/json",
};
const chatSession = model.startChat({
generationConfig
});
const result = await chatSession.sendMessage(event.Body);
const aiResponse = result.response.text()
Xpenser qualifies for the Twilio Times Two prize category by utilizing multiple Twilio features: Verify, Functions, and WhatsApp Messaging.
It was a great experience to work on this project while exploring Twilio services and integrating AI to enhance the user experience. Thanks to Dev.to team for this amazing hackathon.
Love what you have built!