Database Design & Development

CSE4005

Database Models and Server Storage

W.R.A. Amasha Rathnayake

MSc in Big Data Analytics, Robert Gordon University
BSc (Hons) in Industrial Statistics, University of Colombo
Data Models
✓ Underlying the structure of a database is the data model.

✓ Data Model is a collection of conceptual tools for describing data, data relationships, data

semantics, and consistency constraints.

✓ A data model provides a way to describe the design of a database at the physical, logical, and view

levels.

✓ The data models can be classified into different categories:

Hierarchical model

Relational Model

Network Model
2
Hierarchical Data Model
✓ Stores data as hierarchically related to each other.
✓ Record shape are tree structure.
✓ Logically represented by an upside-down tree.
Each parent can have many children
Each child has only one parent

3
Hierarchical Data Model
✓ Several records or files are hierarchically related with each other.
✓ For example, an organization has several departments, each of which has attributes such as name of
director, number of staffs, annual products etc.
✓ Each department has several divisions with attributes of name of manager, number of staffs, annual
products etc.
✓ Then each division has several sections with attributes such as name of head, number of staff, number
of PCs etc.

4
Hierarchical Data Model
Advantages
✓ High speed access to large databases
✓ Easy to update- (to add or delete new nodes)

Disadvantages
✓ Links are only possible in Vertical Direction (from top to bottom) but not for horizontal or diagonal
unless they have same parents

5
Relational Data Model
✓ The relational model uses a collection of tables to represent both data and the relationships among
those data.
✓ Each table has multiple columns, and each column has a unique name.
✓ Tables are also known as relations.
✓ The relational model is an example of a record-based model.
✓ Record-based models are so named because the database is structured in fixed-format records of
several types.
✓ Each table contains records of a particular type. Each record type defines a fixed number of fields, or
✓ attributes.
✓ The columns of the table correspond to the attributes of the record type.
✓ The relational data model is the most widely used data model, and a vast majority of current database
systems are based on the relational model.
6
Relational Data Model

7
Relational Data Model
Advantages
✓ Data Integrity and Accuracy
Uses keys (primary and foreign keys) and constraints to maintain data accuracy and prevent redundancy.
✓ Flexibility in Querying
Supports SQL for complex queries, making it easy to retrieve and manipulate data across multiple tables.
✓ Data Independence
Physical data storage changes do not impact logical data structure, making it adaptable to changes in
storage technology.
✓ Standardization
Widespread use of SQL provides a standard for database interaction, making it easier to learn and use
across systems.
✓ Scalability
Can handle large amounts of data and multiple users, making it suitable for large, enterprise-level
applications. 8
Relational Data Model
Disadvantages
✓ Complexity with Large Datasets
Performance can slow with extremely large databases and complex queries due to joins and data
processing.
✓ Rigid Structure
Requires predefined schemas; any structural changes (e.g., adding columns) can be challenging in a
highly normalized database.
✓ Cost of Setup and Maintenance
Setting up and maintaining relational databases, especially for large systems, can be costly in terms of
resources and expertise.
✓ Inefficiency with Unstructured Data
Not ideal for handling unstructured data (e.g., text, images), which are better suited to NoSQL
databases.
9
Network Model
✓ Doesn't force data into hierarchical levels
✓ Owner/Member relationships
Owner record type
Member record type
✓ Each owner may have one or more member types
✓ Each member type and corresponding owner record type form set, which represents relationship.
Each set has owner record and member record
Member may have several owners
A set represents a 1:M (1 to many) relationship between the owner and the member

10
Network Model

11
Data Dictionary
✓ We can define a data dictionary as a DBMS component that stores the definition of data characteristics and
relationships.
✓ The DBMS data dictionary provides the DBMS with itself describing characteristic.
✓ For example, the data dictionary typically stores descriptions of all:
Data elements that are define in all tables of all databases. Specifically, the data dictionary stores the
name, datatypes, display formats, internal storage formats, and validation rules. The data dictionary tells where an
element is used, by whom it is used and so on.
Tables define in all databases. For example, the data dictionary is likely to store the name of the table
creator, the date of creation access authorizations, the number of columns, and so on.
Define databases who created each database, the date of creation where the database is located, who
the DBA is and so on.
End users and The Administrators of the data base
Programs that access the database including screen formats, report formats application formats, SQL
queries and so on. 12
Data Dictionary
✓ Hierarchical Model
Data Dictionary Role: Stores metadata about the database structure, capturing relationships in a parent-child
hierarchy.

✓ Relational Model
Data Dictionary Role: Stores details about tables, columns, and constraints to define relationships within a
tabular format.

✓ Network Model
Data Dictionary Role: Captures data structure in a graph format, detailing node-link relationships.

13
Data-Manipulation Language (DML)
✓ A Data Manipulation Language (DML) is a language that enables users to access or manipulate data as

organized by the appropriate data model.

✓ The types of access are:

Retrieval of information stored in the database
Insertion of new information into the database
Deletion of information from the database
Modification of information stored in the database

✓ There are basically two types:

✓ Procedural DMLs require a user to specify what data are needed and how to get those data.

✓ Declarative DMLs (also referred to as nonprocedural DMLs) require a user to specify what data are needed

without specifying how to get those data.

14
Data-Manipulation Language (DML)
✓ Declarative DMLs are usually easier to learn and use than are procedural DMLs.

✓ However, since a user does not have to specify how to get the data, the database system has to figure out an

efficient means of accessing data.

✓ A query is a statement requesting the retrieval of information.

✓ The portion of a DML that involves information retrieval is called a query language.

Ex:

SELECT - Retrieve data from the database

INSERT - Insert data into a table

UPDATE - Updates existing data within a table

DELETE - deletes all records from a table, the space for the records remain
15
Data-Definition Language (DDL)
✓ Data Definition Language (DDL) statements are used to define the database structure or schema.

Ex:

CREATE - to create objects in the database

ALTER - alters the structure of the database

DROP - delete objects from the database

TRUNCATE - remove all records from a table, including all spaces allocated for the records are removed

COMMENT - add comments to the data dictionary

RENAME - rename an object

16
Server Storage
✓ Server storage is the traditional storage setup within a server environment, often pre-allocated and static.

✓ This is typically fixed; storage capacity is pre-set for each server or application.

✓ Limited Scalability. requires manual intervention to add or reduce storage capacity.

✓ May lead to over-provisioning costs due to pre-allocated storage that's not fully utilized.

✓ Requires manual management and maintenance, especially for upgrades or scaling.

✓ Suitable for applications with predictable, stable storage needs.

Ex: Traditional databases, file storage in on-premises data centers.

17
Dynamic Storage
✓ Dynamic storage is a flexible storage approach that adjusts automatically based on current storage needs.
✓ Resource allocation is done on-demand, allowing storage to grow or shrink as needed.
✓ Highly scalable; storage can expand or contract automatically in real time.
✓ Cost-effective; users pay for only what they need, reducing wasted resources.
✓ Often managed automatically, with minimal manual intervention needed.
✓ Ideal for applications with fluctuating or unpredictable storage needs, such as cloud services and data
analytics.
Ex: Cloud storage (AWS S3, Google Cloud Storage), thin provisioning in virtualized environments.

Server Storage: Best for stable, predictable environments where storage needs are well-defined and rarely
change.
Dynamic Storage: Optimal for environments requiring high flexibility, such as cloud and virtualized
settings, where storage needs fluctuate.

18
Data Warehousing
✓ Data warehousing is combining data from multiple sources into one comprehensive and easily

manipulated database.

✓ The primary aim for data warehousing is to provide businesses with analytics results from data

mining, OLAP, Score carding and reporting.

Need for Data Warehousing

✓ Information is now considered as a key for all the works.

✓ Those who gather, analyze, understand, and act upon information are winners.

✓ Information have no limits, it is very hard to collect information from various sources, so we need and

data warehouse from where we can get all the information.

19
Data Warehousing Architecture

✓ Data warehousing is designed to provide

an architecture that will make cooperate
data accessible and useful to users.
✓ There is no right or wrong architecture.
✓ The worthiness of the architecture can
be judge by its use, and concept behind
it.
✓ Data Warehouses can be architected in
many ways, depending on the specific
needs of a business.

20
 Operational Applications ETL Process DW Stagging Area

✓ An operational data store (ODS) ✓ ETL (Extract, Transform, Load) is ✓ The Data Warehouse
is basically a database that is used to copy data from: Staging Area is temporary
used for being n temporary • ODS to data warehouse location where data from
storage area for a data staging area. source systems is copied.
warehouse. • Data warehouse staging ✓ It increases the speed of
✓ Its primary purpose is for area to data warehouse. data warehouse
handling data which are • Data warehouse to data architecture.
progressively in use. mart . ✓ It is very essential since
✓ Operational data store contains ✓ ETL extracts data, transforms data is increasing day by
data which are constantly values of inconsistent data, day.
updated through the course of cleanses "bad" data, filters data
the business operations. and loads data into a target
database.
 Data Warehousing and Data Mart
Data Warehouse Data Mart

✓ The purpose of the Data Warehouse is to integrate ✓ A data mart is a simple form of a data warehouse
corporate data. that is focused on functional area such as sales,
✓ The amount of data in the Data Warehouse is finance or marketing
massive. Data is stored at a very deep level of ✓ Data marts are often built and controlled by a
detail. single department within an organization.
✓ This allows data to be grouped in unimaginable ✓ Given their single-subject focus, data marts
ways. usually draw data from only a few sources.
✓ Data Warehouses does not contain all the data in ✓ The sources could be internal operational
the organization, its purpose is to provide base systems, a central data warehouse, or external
that are needed by the organization for strategic data.
and tactical decision making.
Data Mart

Reasons for creating a Data Mart

✓ Easy access to frequently needed data.

✓ Creates collective view by a group of users.

✓ Improves user response time.

✓ Ease of creation.

✓ Lower cost than implementing a full Data

warehouse
Data Mining
✓ Data mining, the extraction of hidden predictive information from large databases

✓ The overall goal of the data mining process is to extract information from a data set and transform it

into an understandable structure for further use

✓ Often Not to be confused with analytics, information extraction, or data analysis

✓ But its goal is the extraction of patterns and knowledge from large amount of data, not the extraction

of data itself

✓ Use for Extremely large datasets and it cannot be done manually

24
Data Mining
✓ Data mining, the extraction of hidden predictive information from large databases

✓ The overall goal of the data mining process is to extract information from a data set and transform it

into an understandable structure for further use

✓ Often Not to be confused with analytics, information extraction, or data analysis

✓ But its goal is the extraction of patterns and knowledge from large amount of data, not the extraction

of data itself

✓ Use for Extremely large datasets and it cannot be done manually

25
Data Mining Tasks
Data Mining Applications
 Scientific Analysis Insurance & Healthcare Research
(Ex: Engineering and Technology) (Medical Science)

✓ In Electrical Power Engineering: ✓ Data mining has been widely ✓ Helps to Develop the
✓ Used for condition monitoring of used in area of bioinformatics, search algorithms
high voltage electrical genetics ✓ It offers huge libraries of
equipment ✓ DNA sequences and variability graphing and visualisation
✓ Vibration monitoring and in disease susceptibility which software's
analysis of transformer on load is very important to help ✓ The users can easily
tap-changers improve the diagnosis, create the models
✓ Education: prevention and treatment of the optimally
✓ To concentrate their knowledge diseases
Data Mining Tools

29
Mobile Databases
✓ A Mobile Database is a type of database that can be accessed by a mobile network and connected to

a mobile computing device (or wireless network).

✓ Here, there is a wireless connection between the client and the server.

✓ It will work with a variety of various devices, including Mobile Databases powered by iOS and Android,

among others.

✓ Couchbase Lite, Object Box, and other popular databases are examples of mobile databases.

30
Mobile Databases
Mobile Database Environment has the Following Components:

✓ For storing the corporate and providing the corporate applications, a Corporate Database Server and

DBMS is used.

✓ For storing the mobile data and providing the mobile application, a Remote Database and server are

used.

✓ There is always a two-way communication link present between the Mobile DBMS and Corporate

DBMS.

31
Mobile Databases
Features of Mobile Database

✓ As more people utilize laptops, smartphones, and PDAs to live on the go.

✓ To prevent frequent transactions from being missed due to connection failure, a cache is kept.

✓ Mobile Databases and the main database server are physically independent.

✓ Mobile gadgets hosted Mobile Databases.

✓ Mobile Databases can communicate with other mobile clients or a centralized database server from distant

locations.

✓ Due to unreliable or nonexistent connections, mobile users need to be able to operate without a wireless

connection with the aid of a Mobile Database (disconnected).

✓ Information on mobile devices is analyzed and managed using a Mobile Database.

32
Mobile Databases
Limitations:
There are a lot of limitations or drawbacks available, which are pointed out below:

✓ Its wireless bandwidth is restricted.

✓ It is very difficult work to make this database theft-proof.

✓ To operate this, we need unlimited battery power.

✓ Wireless communication speed suffers in mobile databases.

✓ In terms of security, it is less secure

33
Document Management Systems
✓ Document Management System (DMS) is an electronic solution that help organization to streamline their
document management processes
✓ It enables scanning, storage, retrieval, sharing, tracking, revision and distribution of documents and
hence information and data they contain.

Why DMS is effective?

Centralized source of information
Improved security
Cost effectiveness
Improved workflow
Maximized customer satisfaction

34
Document Management Systems
Types of DMS

35
Document Management Systems
Web Based DMS
✓ Web-based document management system is a central repository of your business documents so you
can access them anytime, anywhere.

Features of web based DMS:

Centralized and Fully Secured Document Storage.
Groupwise Folder Access Policy.
Project wise Centralized Directory Structures.
Web based File Manager For Upload/Download operations.
File Versioning.
Extended User Access Policy For Every Folder.
Enterprise Document Management facilities Department-wise File cabinets.
Easy to use Admin Panel. 36
Document Management Systems
Electronic Record Management DMS
✓ An electronic records management system (ERM) is a software that manages electronic files and
documents as records.
✓ With electronic records management (ERM), you can be sure that your company has the records it requires,
when it requires them

Types of Electronic Management Systems:

Content Management Systems (CMS): CMS goes beyond documents to manage various content types, like
text, images, videos, and more. it’s like a versatile tool for creating, organizing, and sharing content, especially
on websites or in digital marketing.
Email Management Systems: These systems are tailor-made for handling email records and messages. They
help archive, search, and keep track of emails, attachments, and related info. Think of them as expert
organizers for your email inbox.
37
Document Management Systems
Electronic Record Management DMS
Importance of ERM:
✓ Legal and Regulatory Compliance: Ensures organizations meet legal requirements for record retention
and privacy.
✓ Risk Mitigation: Minimizes risks associated with data loss, litigation, and non-compliance.
✓ Efficiency and Productivity: Speeds up document retrieval and search that boosts business.
✓ Data Security: Safeguards sensitive information from unauthorized access.
✓ Resource Optimization: Reduces physical storage costs and space requirements.
✓ Enhanced Collaboration: Enables effective sharing and collaboration on records.
✓ Improved Decision-Making: Access to accurate, timely data supports better decision-making.

38
Document Management Systems
Workflow DMS
✓ It provides infrastructure for the set up, performance and monitoring of a defined sequence of tasks,
arranged as a workflow

Document Imaging DMS

✓ Document imaging it is the conversion of paper files into digital images
✓ It can take many forms such as,
✓ Microfilm
✓ On demand printers
✓ Copiers
✓ Multifunction printers
✓ Document scanners
✓ Archive writers
39
Client Database
✓ A client database, also called a customer database or customer relationship management (CRM), is a
valuable tool that allows a business to track and manage its customers by collecting their information.
✓ Those CRM databases stores client data, allowing the business to access details about its customers
promptly.
✓ The specific details in the database can vary depending on a company's needs.
✓ There's a wide range of customer data you can include in your database, such as: Contact information,
Quotes, Special notes, Purchase history, Incidents, Customer preferences, Customer service tickets,
Feedback, Geographic location, Payment methods, VIP or loyal membership, status, Additional offers

40
Client Database
Benefits of Client Database:
✓ Cost-effectiveness: Many CRM tools are free or have a low monthly fee to use them. This is especially
beneficial for freelance businesses because it allows them to save funds and allocate money toward other
important operations, like marketing initiatives and ordering supplies.
✓ Ease of use: One of the primary benefits of client databases is their ease of use, making them accessible
for anyone to implement into their business. This is an ideal quality for customer databases so that the
system can provide a positive experience for users.
✓ Mobile compatibility: As consumers increasingly make purchases on digital platforms, databases with
mobile compatibility are becoming more relevant. CRMs that have this feature can help you track and
gather critical customer information in real time, no matter where you are.
✓ Problem-solving: If a customer contacts you about a complaint, concern or some form of a transactional
discrepancy, you can use the database to verify their purchase history and other pertinent details. This
helps ensure that you're able to resolve issues in a timely manner.
41
Server Database
✓ A server database is a database that resides on a central server and is accessed by multiple clients, often
across a network.
✓ It allows for centralized data storage, management, and retrieval, and is typically designed to handle multiple,
concurrent requests.

Features of Server Database

Centralized Storage: A server database stores data on a central server, making it accessible to users and
applications that connect to the server over a network.
Multi-user Access: Unlike desktop databases (e.g., Microsoft Access), server databases are designed for
multiple users to access and manipulate the data simultaneously, making them ideal for organizations with
a high volume of transactions.
Data Security: Server databases include robust security measures, such as user authentication,
authorization, and encryption, to protect sensitive data and control who can access or modify it.
42
Server Database
Features of Server Database
Backup and Recovery: Server databases typically offer built-in backup and recovery mechanisms to protect
data from loss or corruption.
High Performance and Scalability: Server databases are built to handle large volumes of data and
transactions with minimal downtime. They often provide features like load balancing, data partitioning, and
clustering to optimize performance.

Examples of Server Databases

SQL Server by Microsoft
Oracle Database
MySQL and PostgreSQL

43
Digital Library
✓ A digital library (also called an online library, an internet library, a digital repository, a library without walls,

or a digital collection) is an online database of digital objects that can include text, still images, audio,

video, digital documents, or other digital media formats or a library accessible through the internet.

✓ Objects can consist of digitized content like print or photographs, as well as originally produced digital

content like word processor files or social media posts.

44
.

Thank you