A Novel Technique for Efficient Storage and Retrieval of Massive Data Sets

dc.contributor.guideBatra, Shalini
dc.coverage.spatial
dc.creator.researcherSingh, Amritpal
dc.date.accessioned2020-10-23T05:17:26Z
dc.date.available2020-10-23T05:17:26Z
dc.date.awarded
dc.date.completed2018
dc.date.registered
dc.description.abstractIn today s world data is considered as one of the most valuable assets. With the coming up of plethora of web applications and technologies like sensors, IoT, cloud computing, etc., the in-stream data generation resources have increased exponentially. Data originating from heterogeneous sources and real world applications is severely susceptible to inconsistent, incomplete and noisy data. To support data applications in different domains, data processing must be efficient and automated as much as possible. Further, timely and accurate analysis of available data is an intrinsic requirement. Conventional databases and traditional data mining techniques are efficient for stored data analytic but for in-streamed data, where data is arriving continuously, it is not feasible to store the data into databases and then perform analysis since all such applications demand time bound query output. Moreover, traditional approaches demand that entire data should be stored in a formatted manner. Massive datasets require architectures and tools for data storage, handling, processing and mining of the bulk information in limited time and in single pass. One of the available alternative is use of Probabilistic Data Structures (PDS) in Big data analytics, which use some probability based approaches, approximation principals and hashing methods to reduce time and space trade off in storage, retrieval and search of data. This thesis proposes three techniques for streamed data analysis. First one, a variant of scalable Bloom Filter (BF), called AdapTable Bloom Filter (ATBF), performs peak hour analysis and decides the size of dynamic BF apriori using Kalman filter and Learning Array (LA). In second approach, a variant of stable BF, called FingerPrint Stable Bloom Filter(FPSBF), has been proposed for duplicate detection in streamed data. In the third approach, a semi-supervised technique for spam detection in Twitter has been proposed which employs ensemble based framework (Eb-SDF) comprising of four classifiers.
dc.description.note
dc.format.accompanyingmaterialDVD
dc.format.dimensions
dc.format.extent146p.
dc.identifier.urihttp://hdl.handle.net/10603/303952
dc.languageEnglish
dc.publisher.institutionDepartment of Computer Science and Engineering
dc.publisher.placePatiala
dc.publisher.universityThapar Institute of Engineering and Technology
dc.relation
dc.rightsuniversity
dc.source.universityUniversity
dc.subject.keywordBloom Filter
dc.subject.keywordProbabilistic data structures
dc.subject.keywordQuotient Filter
dc.titleA Novel Technique for Efficient Storage and Retrieval of Massive Data Sets
dc.title.alternative
dc.type.degreePh.D.

Files

Original bundle

Now showing 1 - 5 of 17
Loading...
Thumbnail Image
Name:
01_title.pdf
Size:
90.84 KB
Format:
Adobe Portable Document Format
Description:
Attached File
Loading...
Thumbnail Image
Name:
02_contents.pdf
Size:
66.54 KB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
03_list of figures.pdf
Size:
52.35 KB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
04_list of tables.pdf
Size:
47.61 KB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
05_list of algorithms.pdf
Size:
47.84 KB
Format:
Adobe Portable Document Format

License bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
1.79 KB
Format:
Plain Text
Description: