01 Project Synopsis
₹49
One-time Payment
- PDF & Word Formats
- Project Introduction & Objectives
- Problem Statement & Methodology
- System Architecture Diagram included
- Structured for Review & Customization
Project Report
Voice Controlled Desktop Assistant Final Year Project Report
Get structured Voice Controlled Desktop Assistant Final Year Project Report Final Year Project Report and Documentation with project objectives, methodology, system design, diagrams, implementation details, testing and complete project explanations. Suitable as a learning, documentation and project-presentation resource for students working on related final year projects.
Need a customized report? Chat on WhatsAppChoose the Report Package That Fits You Best
Simple pricing. Instant access. Every package includes PDF & Word format.
02 Detailed Project Report
₹99
One-time Payment
- PDF & Word Formats
- Structured Project Chapters
- UML / DFD / Technical Diagrams
- Methodology, Implementation & Testing
- Structured chapters & technical diagrams
03 Customized Project Report
₹149
One-time Payment
- PDF & Word both included
- Customized to your college documentation format
- Project-specific customized documentation
- Structured chapters & technical diagrams
- Delivery within 24-48 hours
04 Customized Plagiarism-Free Report
₹299
One-time Payment
- PDF & Word both included
- Plagiarism-free project content
- Original & project-specific writing
- Clear, natural & readable documentation
- Delivery within 24-48 hours
-
—
Abstract
-
—
Table of Content
-
01
Introduction
-
02
Problem Statement
-
03
Existing System
-
04
Proposed System
-
05
Objectives
-
06
System Architecture
-
07
Major Functional Modules
-
08
Hardware Requirements
-
09
Software Requirements
-
10
Future Enhancement
-
11
Conclusion
-
12
References
-
—
Abstract
-
—
Table of Content
-
01
Chapter 1 — Introduction
- 1.1 Background of the Project
- 1.2 Problem Statement
- 1.3 Objectives of the System
- 1.4 Scope of the Project
- 1.5 Existing System Overview
- 1.6 Proposed System Overview
- 1.7 Technologies Used
- 1.8 Overview
- 1.9 Limitations
- 1.10 Advantages
- 1.11 Disadvantages
-
02
Chapter 2 — Literature Review / System Study
- 2.1 Introduction
- 2.2 Review of Similar Systems
- 2.3 Comparative Analysis
- 2.4 Software Development Models
-
03
Chapter 3 — System Analysis
- 3.1 Introduction
- 3.2 Functional Requirements
- 3.3 Non-Functional Requirements
- 3.4 User Requirements
- 3.5 Feasibility Study
- 3.5.1 Technical Feasibility
- 3.5.2 Economic Feasibility
- 3.5.3 Operational Feasibility
- 3.6 System Architecture
- 3.7 Data Flow Diagram (Level 0)
- 3.8 Data Flow Diagram (Level 1)
- 3.9 Data Flow Diagram (Level 2)
-
04
Chapter 4 — System Design
- 4.1 Introduction
- 4.2 Use Case Diagram
- 4.3 Class Diagram
- 4.4 Sequence Diagram
- 4.5 Activity Diagram
- 4.6 ER Diagram
- 4.7 Database Schema
- 4.8 Table Structures
-
05
Chapter 5 — System Implementation
- 5.1 Introduction
- 5.2 Development Environment
- 5.3 Tools and Technologies Used
- 5.4 Hardware Requirements
- 5.5 Software Requirements
- 5.6 Module-wise Implementation
-
06
Chapter 6 — Testing
- 6.1 Introduction
- 6.2 Testing Strategy
- 6.3 Unit Testing
- 6.4 Integration Testing
- 6.5 System Testing
- 6.6 Test Cases
- 6.7 Bug Reports
-
07
Chapter 7 — Results and Discussion
- All screenshots
-
08
Chapter 8 — Conclusion and Future Enhancements
- 8.1 Conclusion
- 8.2 Future Enhancements
-
09
Chapter 9 — References
Project's Overview
Voice Controlled Desktop Assistant & Automation System is a Python and Flask-based Windows desktop automation application designed to execute computer operations through voice or typed commands. Users can open and close applications, launch websites, access files and folders, control media, search Google or YouTube, run system actions, create macros, schedule tasks, manage reminders, and automate multi-step desktop workflows.
The project uses offline Vosk speech-to-text and pyttsx3 text-to-speech, so speech recognition and voice feedback can work locally without requiring a cloud speech API. The platform provides a browser-based web interface at http://127.0.0.1:5000, while desktop commands are executed directly on the Windows machine running the application.
The system supports both browser microphone streaming and server/PC microphone input, fuzzy command matching, command corrections, typed command execution, role-based permissions, blocked commands, confirmation prompts for critical actions, personal commands, macros, sequences, notes, reminders, tasks, scheduled automation, history, reports, and database backup.
A complete Admin Panel is provided for managing users, roles, voice commands, applications, websites, files, folders, macros, sequences, scheduled tasks, reminders, TTS settings, microphone settings, recognition settings, permissions, logs, reports, and SQLite database backups.
This project is suitable for B.Tech, M.Tech, BCA, MCA, BE, ME, BSc, MSc, AI, Python, and Computer Science students who need a practical final year project, major project, or minor project based on voice recognition, desktop automation, Python Flask development, offline speech processing, human-computer interaction, command matching, task scheduling, macros, and system automation.
Login Credentials
The default administrator account is created when the database is empty.
| Role | Username | Password | |
|---|---|---|---|
| Admin | admin |
admin123 |
[email protected] |
Default roles:
| Role | Access |
|---|---|
| Admin | All permissions |
| User | use_assistant, execute_apps |
Related & Popular Reports
View all
Dashboard
- View system statistics
- View total users
- View total commands
- View recent activity
- Access management modules
Admin Profile
- View admin profile
- Update profile
- Change admin password
User Management
- Create user
- Edit user
- Activate user
- Deactivate user
- Reset user password
- Assign user role
- Manage user accounts
Role Management
- Create and manage roles
- Assign permissions
- Manage permission such as:
manage_usersexecute_appsuse_assistant
- Define role-based access
Voice Command Categories
- Create command category
- Edit category
- Organize commands by type
- Categories such as:
- Applications
- Websites
- Media
- System
- Search
Voice Commands Management
- Add voice command
- Edit command
- Delete command
- Add trigger phrase
- Add alternative phrases
- Select action type
- Configure JSON payload
- Enable command
- Disable command
Application Registry
- Register desktop application
- Add application path
- Configure application open phrase
- Configure close phrase
- Add process name
- Manage desktop application automation
Website Registry
- Add website
- Add website URL
- Add voice keyword
- Launch registered website through command
File Registry
- Register file path
- Add voice keyword
- Open file by voice
Folder Registry
- Register folder
- Add folder voice keyword
- Open folder through voice command
Global Custom Commands
- Create custom phrase
- Map command to action
- Configure global command behavior
Sequences
- Create multi-step workflow
- Add ordered actions
- Execute several actions using one phrase
- Example:
start my work
Macros
- Create macro
- Add multiple ordered actions
- Add keyboard actions
- Open apps
- Execute automation workflow
Scheduled Tasks
- Create time-based automation
- Schedule an action for later execution
- View scheduled tasks
- Manage automation jobs
Reminders
- Admin-created reminders
- Scheduler-backed reminders
- Manage reminder jobs
Text-to-Speech Settings
- Enable or disable speech
- Select voice
- Change speaking rate
- Change volume
Confirmation Settings
- Require confirmation for shutdown
- Require confirmation for restart
- Configure sensitive operation confirmation
Permission Settings
- Restrict system commands
- Restrict application launch
- Apply role permissions
Blocked Commands
- Block selected phrases
- Prevent restricted commands from executing
Search Settings
- Enable/disable Google search
- Enable/disable YouTube search
- Configure search defaults
Browser Settings
- Set default browser
- Add custom browser path
Microphone Settings
- Configure device index
- Configure sample rate
- Configure chunk size
- Configure server microphone
Recognition Settings
- Configure fuzzy-match threshold
- Configure default listening behavior
Command Logs
- View spoken commands
- View typed commands
- View successful executions
- View failed executions
Login History
- View successful login records
Failed Login History
- View failed authentication attempts
Application Usage
- Track application open events
- Track application close events
Schedule History
- View scheduled jobs that were executed
Feedback Management
- View user-submitted feedback
Reports
- Export analytics
- Export logs
- Generate CSV reports
Backup
- Create SQLite database backup
- Restore SQLite database from backup
The admin panel contains user/role management, command catalogs, desktop registries, automation, configuration, logs, CSV reporting, feedback and database backup/restore functionality.
Authentication
- User registration
- User login
- User logout
- Forgot password
- Reset password
- Change password
- Session-based authentication
User Dashboard
- Personal dashboard
- Quick access to Voice Assistant
- Quick links to productivity modules
- Personal automation overview
- Recent activity access
Voice Assistant
- Start voice listening
- Stop voice listening
- Browser microphone input
- PC/server microphone fallback
- View partial speech recognition text
- View final recognized text
- Execute recognized command
- Type command manually
- Execute typed command
- Quick voice phrases
- Confirmation dialog for sensitive operations
- Spoken text-to-speech feedback
- View command execution result
Voice Typing
- Dictate speech into text area
- Speech-to-text focused interface
- Use offline Vosk recognition
- View transcribed text
Personal Notes
- Create note
- Edit note
- Delete note
- Maintain personal notes
Reminders
- Create reminder
- Set reminder due time
- View reminders
- Manage scheduled reminder execution
Tasks
- Create personal task
- Mark task complete
- Delete task
- Maintain simple to-do list
Personal Voice Commands
- Create custom voice phrase
- Map personal phrase to action
- Execute personal commands
- Maintain user-specific command mappings
Voice Macros
- Create multi-step workflow
- Define ordered actions
- Execute macro using voice phrase
- Maintain personal automation workflows
Scheduled Tasks
- Create scheduled action
- Configure execution time
- Run task through APScheduler
- View user-owned scheduled actions
Command History
- View previously executed commands
- View voice commands
- View typed commands
- View execution success/failure
Account
- View profile
- Update profile
- Change password
- View microphone guidance
- Browse command help
- Submit feedback to admin
The normal user panel includes Dashboard, Voice Assistant, Voice Typing, Notes, Reminders, Tasks, Personal Commands, Voice Macros, Scheduled Tasks, Command History, Profile, Microphone Help, Password, Commands Help and Feedback.
Supported Desktop Actions
Applications
- Open Notepad
- Close Notepad
- Open Calculator
- Open Explorer
- Open Paint
- Open Command Prompt
- Open browser
- Launch registered applications
Websites
- Open Google
- Open YouTube
- Open Gmail
- Launch registered websites
Files and Folders
- Open registered files
- Open registered folders
- Access user-configured file paths
Media Controls
- Play
- Pause
- Stop
- Next track
- Previous track
- Volume up
- Volume down
- Mute
System Actions
- Lock computer
- Sleep
- Shutdown
- Restart
- Logout
Search
- Search Google
- Search YouTube
Automation
- Execute sequence
- Execute macro
- Execute personal command
- Run custom action
These action types are implemented through desktop automation libraries and native Python modules including keyboard, pyautogui, subprocess, os, and webbrowser.
Technology Used
| Layer | Technology |
|---|---|
| Programming Language | Python 3.11+ |
| Backend | Flask 3 |
| Authentication | Flask-Login |
| ORM | Flask-SQLAlchemy / SQLAlchemy 2 |
| Forms / Security | Flask-WTF |
| Password Security | Werkzeug |
| Scheduler | APScheduler |
| Database | SQLite |
| Speech-to-Text | Vosk |
| Microphone | sounddevice / Browser getUserMedia |
| Text-to-Speech | pyttsx3 / Windows SAPI |
| Fuzzy Matching | RapidFuzz |
| Automation | keyboard, pyautogui |
| App Execution | subprocess, os |
| Web Launching | webbrowser |
| Templates | Jinja2 |
| Frontend | Bootstrap 5 |
| JavaScript | Vanilla JS |
| Platform | Windows 10 / 11 |
The project uses Python, Flask, SQLite, Vosk, pyttsx3, RapidFuzz, keyboard, pyautogui, APScheduler, Bootstrap and related desktop automation libraries.
Most Important – Setup Instructions
1. Download the Models Folder
First, download the Models folder from the link below:
https://drive.google.com/file/d/1ppwL9MLHf3Vh9S5FUNf5bbv-LbCvDGmQ/view?usp=sharing
After downloading, extract it if required and place the Models folder inside the root folder of the project.
2. Open Command Prompt / Terminal
Navigate to the project directory:
cd "C:\Project\Python Source Code\Voice Control System"
3. Create a Virtual Environment
python -m venv .venv
4. Activate the Virtual Environment
.venv\Scripts\activate
5. Install Required Dependencies
pip install -r requirements.txt
6. Set Up the Vosk Model
python setup_vosk.py
7. Run the Project
python run.py
8. Open the Application
Once the server starts successfully, open the following URL in your browser:
http://127.0.0.1:5000
Important Note
It is recommended to run the project using the virtual environment (.venv) or the provided run.bat file.
Avoid running the project directly with the system Python installation, as required dependencies such as Vosk may not be available there.
README Included
Setup Support Available
The default administrator account is created when the database is empty.
| Role | Username | Password | |
|---|---|---|---|
| Admin | admin |
admin123 |
[email protected] |
Default roles:
| Role | Access |
|---|---|
| Admin | All permissions |
| User | use_assistant, execute_apps |