Skip to main content

A Hadoop Extension for Analysing Spatiotemporally Referenced Events

Research Abstract
A spatiotemporally referenced event is a tuple that contains both a spatial reference and a temporal reference. The spatial reference is typically a point coordinate, and the temporal reference is a timestamp. The event payload can be the reading of a sensor (IoT systems), a user comment (geo-tagged social networks), a news article (gdelt), etc. Spatiotemporal event datasets are ever growing, and the requirements for their processing goes beyond traditional client-sever GIS architectures. Rather, Hadoop-like architectures shall be used. Yet, Hadoop does not provide the types and operations necessary for processing such datasets. In this paper, we propose a Hadoop extension (indeed a SpatialHadoop extension) capable of performing analytics on big spatiotemporally referenced event dataset. The extension includes data types and operators that are integrated into the Hadoop core, to be used as natives. We further optimize the querying by means of a spatiotemporal index. Experiments on the gdelt event dataset demonstrate the utility of the proposed extension.
Research Authors
Mohamed S Bakli, Mahmoud A Sakr, Taysir Hassan A Soliman
Research Department
Research Journal
International Conference on Advanced Intelligent Systems and Informatics.
Research Member
Research Pages
(pp.905-914)
Research Publisher
Springer International Publishing
Research Rank
3
Research Vol
(Vol 639)
Research Website
https://link.springer.com/chapter/10.1007/978-3-319-64861-3_85
Research Year
2017

A Hadoop Extension for Analysing Spatiotemporally Referenced Events

Research Abstract
A spatiotemporally referenced event is a tuple that contains both a spatial reference and a temporal reference. The spatial reference is typically a point coordinate, and the temporal reference is a timestamp. The event payload can be the reading of a sensor (IoT systems), a user comment (geo-tagged social networks), a news article (gdelt), etc. Spatiotemporal event datasets are ever growing, and the requirements for their processing goes beyond traditional client-sever GIS architectures. Rather, Hadoop-like architectures shall be used. Yet, Hadoop does not provide the types and operations necessary for processing such datasets. In this paper, we propose a Hadoop extension (indeed a SpatialHadoop extension) capable of performing analytics on big spatiotemporally referenced event dataset. The extension includes data types and operators that are integrated into the Hadoop core, to be used as natives. We further optimize the querying by means of a spatiotemporal index. Experiments on the gdelt event dataset demonstrate the utility of the proposed extension.
Research Authors
Mohamed S Bakli, Mahmoud A Sakr, Taysir Hassan A Soliman
Research Department
Research Journal
International Conference on Advanced Intelligent Systems and Informatics.
Research Pages
(pp.905-914)
Research Publisher
Springer International Publishing
Research Rank
3
Research Vol
(Vol 639)
Research Website
https://link.springer.com/chapter/10.1007/978-3-319-64861-3_85
Research Year
2017

A spatiotemporal algebra in Hadoop for moving objects

Research Abstract
Spatiotemporal data represent the real-world objects that move in geographic space over time. The enormous numbers of mobile sensors and location tracking devices continuously produce massive amounts of such data. This leads to the need for scalable spatiotemporal data management systems. Such systems shall be capable of representing spatiotemporal data in persistent storage and in memory. They shall also provide a range of query processing operators that may scale out in a cloud setting. Currently, very few researches have been conducted to meet this requirement. This paper proposes a Hadoop extension with a spatiotemporal algebra. The algebra consists of moving object types added as Hadoop native types, and operators on top of them. The Hadoop file system has been extended to support parameter passing for files that contain spatiotemporal data, and for operators that can be unary or binary. Both the types and operators are accessible for the MapReduce jobs. Such an extension allows users to write Hadoop programs that can perform spatiotemporal analysis. Certain queries may call more than one operator for different jobs and keep these operators running in parallel. This paper describes the design and implementation of this algebra, and evaluates it using a benchmark that is specific to moving object databases.
Research Authors
Mohamed S. Bakli, Mahmoud A. Sakr, Taysir Hassan A. Soliman
Research Department
Research Journal
Geo-spatial Information Science
Research Pages
(PP.102-114)
Research Publisher
Taylor & Francis
Research Rank
1
Research Vol
(Vol 21 - No 2)
Research Website
https://www.tandfonline.com/doi/full/10.1080/10095020.2017.1413798
Research Year
2018

A spatiotemporal algebra in Hadoop for moving objects

Research Abstract
Spatiotemporal data represent the real-world objects that move in geographic space over time. The enormous numbers of mobile sensors and location tracking devices continuously produce massive amounts of such data. This leads to the need for scalable spatiotemporal data management systems. Such systems shall be capable of representing spatiotemporal data in persistent storage and in memory. They shall also provide a range of query processing operators that may scale out in a cloud setting. Currently, very few researches have been conducted to meet this requirement. This paper proposes a Hadoop extension with a spatiotemporal algebra. The algebra consists of moving object types added as Hadoop native types, and operators on top of them. The Hadoop file system has been extended to support parameter passing for files that contain spatiotemporal data, and for operators that can be unary or binary. Both the types and operators are accessible for the MapReduce jobs. Such an extension allows users to write Hadoop programs that can perform spatiotemporal analysis. Certain queries may call more than one operator for different jobs and keep these operators running in parallel. This paper describes the design and implementation of this algebra, and evaluates it using a benchmark that is specific to moving object databases.
Research Authors
Mohamed S. Bakli, Mahmoud A. Sakr, Taysir Hassan A. Soliman
Research Department
Research Journal
Geo-spatial Information Science
Research Member
Research Pages
(PP.102-114)
Research Publisher
Taylor & Francis
Research Rank
1
Research Vol
(Vol 21 - No 2)
Research Website
https://www.tandfonline.com/doi/full/10.1080/10095020.2017.1413798
Research Year
2018

HadoopTrajectory: a Hadoop spatiotemporal data processing extension

Research Abstract
The recent advances in location tracking technologies and the widespread use of location-aware applications have resulted in big datasets of moving object trajectories. While there exists a couple of research prototypes for moving object databases, there is a lack of systems that can process big spatiotemporal data. This work proposes HadoopTrajectory, a Hadoop extension for spatiotemporal data processing. The extension adds spatiotemporal types and operators to the Hadoop core. These types and operators can be directly used in MapReduce programs, which gives the Hadoop user the possibility to write spatiotemporal data analytics programs. The storage layer of Hadoop, the HDFS, is extended by types to represent trajectory data and their corresponding input and output functions. It is also extended by file splitters and record readers. This enables Hadoop to read big files of moving object trajectories such as vehicle GPS tracks and split them over worker nodes for distributed processing. The storage layer is also extended by spatiotemporal indexes that help filtering the data before splitting it over the worker nodes. Several data access functions are provided so that the MapReduce layer can deal with this data. The MapReduce layer is extended with trajectory processing operators, to compute for instance the length of a trajectory in meters. This paper describes the extension and evaluates it using a synthetic dataset and a real dataset. Comparisons with non-Hadoop systems and with standard Hadoop are given. The extension accounts for about 11,601 lines of Java code.
Research Authors
Mohamed Bakli, Mahmoud Sakr, Taysir Hassan A. Soliman
Research Department
Research Journal
Journal of Geographical Systems
Research Pages
NULL
Research Publisher
Springer-Verlag GmbH Germany, part of Springer Nature 2019
Research Rank
1
Research Vol
NULL
Research Website
https://link.springer.com/article/10.1007/s10109-019-00292-4
Research Year
2019

HadoopTrajectory: a Hadoop spatiotemporal data processing extension

Research Abstract
The recent advances in location tracking technologies and the widespread use of location-aware applications have resulted in big datasets of moving object trajectories. While there exists a couple of research prototypes for moving object databases, there is a lack of systems that can process big spatiotemporal data. This work proposes HadoopTrajectory, a Hadoop extension for spatiotemporal data processing. The extension adds spatiotemporal types and operators to the Hadoop core. These types and operators can be directly used in MapReduce programs, which gives the Hadoop user the possibility to write spatiotemporal data analytics programs. The storage layer of Hadoop, the HDFS, is extended by types to represent trajectory data and their corresponding input and output functions. It is also extended by file splitters and record readers. This enables Hadoop to read big files of moving object trajectories such as vehicle GPS tracks and split them over worker nodes for distributed processing. The storage layer is also extended by spatiotemporal indexes that help filtering the data before splitting it over the worker nodes. Several data access functions are provided so that the MapReduce layer can deal with this data. The MapReduce layer is extended with trajectory processing operators, to compute for instance the length of a trajectory in meters. This paper describes the extension and evaluates it using a synthetic dataset and a real dataset. Comparisons with non-Hadoop systems and with standard Hadoop are given. The extension accounts for about 11,601 lines of Java code.
Research Authors
Mohamed Bakli, Mahmoud Sakr, Taysir Hassan A. Soliman
Research Department
Research Journal
Journal of Geographical Systems
Research Member
Research Pages
NULL
Research Publisher
Springer-Verlag GmbH Germany, part of Springer Nature 2019
Research Rank
1
Research Vol
NULL
Research Website
https://link.springer.com/article/10.1007/s10109-019-00292-4
Research Year
2019

A Proposed Lightweight Cloud Security Framework to Secure Communications between Internet of Things Devices

Research Abstract
Cloud services can be categorized into Infrastructure as a Service (IaaS), the Platform as a Service (PaaS) and the Software as a Service (SaaS). In (Iaas), the whole IT infrastructure can be delivered as a service. In (Paas), a virtual platform over the internet gives users the ability to develop and deploy applications. In (SaaS), it provides accessing an application through the internet on demand. In the (SaaS) layer, a single instance on the cloud for multiple users could be provided. Google Apps, one of the most powerful (SaaS) that is used by many institutes to provide a variety of Web-based applications for business, education, and government. Security in Cloud computing is an important and critical problem. Cloud service provider and the cloud service consumer should make sure that the cloud is safe enough from all the external threats so that the customer does not face any problem such as loss of data or data theft. Internets of Things (IoT) are small IP enabled devices that can cooperate to perform specific functions for various set of applications. This new emerging technology is strongly involved in applications that have direct impact on human welfare, such as business, education and government. Securing IoT device's communications are becoming a must. In this paper a lightweight technique for secure and authentic communication between IoT devices. That lightweight technique is based on framework of ideas from virtual server, network management and cloud services.
Research Authors
1. Taj-Eddin, Islam A.T.F.; Abou El-Seoud, M. Samir; El-Sofany, Hosam;
Research Department
Research Journal
Proceedings of the 20th International Conference on Interactive Collaborative Learning (ICL2017), Budapest, Hungary, 27-29 September 2017,
Research Pages
517-525
Research Publisher
Auer M., Guralnick D., Simonics I. (eds), Advances in Intelligent Systems and Computing-vol. 716, Teaching and Learning in a Digital World, Proceedings of the 20th International Conference on ICL-vol. 2, ISBN: 978-3-319-73203-9 (Print), 978-3-319-73204-
Research Rank
3
Research Vol
NULL
Research Website
http://www.icl-conference.org/icl2017/
Research Year
2017

Comparable and analytical Study between Some Security Issues in Cloud Computing

Research Abstract
Cloud Computing appears as a computational model and a distributive architecture framework. The main objectives of cloud computing are to provide secure, quick, convenient data storage and net computing service, with all computing resources visualized as services and delivered over the Internet. The term “Cloud Computing” has been in the spotlights of IT, CS and CE specialists in the last years because of its potential to transform this industry. Security in Cloud Computing is an important and critical aspect, and has numerous issues and problem related to it. Cloud service provider and the cloud service consumer should make sure that the cloud is safe enough from all the external threats so that the customer does not face any problem such as loss of data or data theft. This research presents and classifies the factors that affect the security of the cloud then it explores the cloud security issues and problems faced by cloud service provider and cloud service consumer. The main goal of this research study is to introduce a comparable analysis for the proposed security issues, the security categories, and the cloud computing services.
Research Authors
Abou El-Seoud, M. Samir; El-Sofany, Hosam; Taj-Eddin, Islam A.T.F.;
Research Department
Research Journal
Proceedings of the 20th International Conference on Interactive Collaborative Learning (ICL2017), Budapest, Hungary, 27-29 September 2017,


Research Pages
526-539
Research Publisher
Auer M., Guralnick D., Simonics I. (eds), Advances in Intelligent Systems and Computing-vol. 716, Teaching and Learning in a Digital World, Proceedings of the 20th International Conference on ICL-vol. 2, ISBN: 978-3-319-73203-9 (Print), 978-3-319-73204-
Research Rank
3
Research Vol
NULL
Research Website
http://www.icl-conference.org/icl2017/
Research Year
2017

Can We See Photosynthesis? Magnifying the Tiny Color Changes of Plant Green Leaves Using Eulerian Video Magnification

Research Abstract
Plant aliveness is proven through laboratory experiments and special scientific instruments. We aim to detect the degree of animation of plants based on the magnification of the small color changes in the plant’s green leaves using the Eulerian video magnification. Capturing the video under a controlled environment, e.g., using a tripod and direct current light sources, reduces camera movements and minimizes light fluctuations; we aim to reduce the external factors as much as possible. The acquired video is then stabilized and a proposed algorithm is used to reduce the illumination variations. Finally, the Euler magnification is utilized to magnify the color changes on the light invariant video. The proposed system does not require any special purpose instruments as it uses a digital camera with a regular frame rate. The results of magnified color changes on both natural and plastic leaves show that the live green leaves have color changes in contrast to the plastic leaves. Hence, we can argue that the color changes of the leaves are due to biological operations, such as photosynthesis. To date, this is possibly the first work that focuses on interpreting visually, some biological operations of plants without any special purpose instruments.
Research Authors
Islam A.T.F. Taj-Eddin, Mahmoud Afifi, Mostafa Korashy, Ali H. Ahmed, Ng Yoke Cheng, Evelyng Hernandez, Salma M. Abdel-latif
Research Department
Research Journal
Journal of Electronic Imaging
Research Member
Research Pages
(060501-1)-(060501-4)
Research Publisher
the international society for optics and photonics (SPIE), doi: 10.1117/1.JEI.26.6.060501
Research Rank
1
Research Vol
Vol 26-No 6
Research Website
https://www.spiedigitallibrary.org/journals/Journal-of-Electronic-Imaging/volume-26/issue-6/060501/Can-we-see-photosynthesis-Magnifying-the-tiny-color-changes-of/10.1117/1.JEI.26.6.060501.short
Research Year
2017

Can We See Photosynthesis? Magnifying the Tiny Color Changes of Plant Green Leaves Using Eulerian Video Magnification

Research Abstract
Plant aliveness is proven through laboratory experiments and special scientific instruments. We aim to detect the degree of animation of plants based on the magnification of the small color changes in the plant’s green leaves using the Eulerian video magnification. Capturing the video under a controlled environment, e.g., using a tripod and direct current light sources, reduces camera movements and minimizes light fluctuations; we aim to reduce the external factors as much as possible. The acquired video is then stabilized and a proposed algorithm is used to reduce the illumination variations. Finally, the Euler magnification is utilized to magnify the color changes on the light invariant video. The proposed system does not require any special purpose instruments as it uses a digital camera with a regular frame rate. The results of magnified color changes on both natural and plastic leaves show that the live green leaves have color changes in contrast to the plastic leaves. Hence, we can argue that the color changes of the leaves are due to biological operations, such as photosynthesis. To date, this is possibly the first work that focuses on interpreting visually, some biological operations of plants without any special purpose instruments.
Research Authors
Islam A.T.F. Taj-Eddin, Mahmoud Afifi, Mostafa Korashy, Ali H. Ahmed, Ng Yoke Cheng, Evelyng Hernandez, Salma M. Abdel-latif
Research Department
Research Journal
Journal of Electronic Imaging
Research Pages
(060501-1)-(060501-4)
Research Publisher
the international society for optics and photonics (SPIE), doi: 10.1117/1.JEI.26.6.060501
Research Rank
1
Research Vol
Vol 26-No 6
Research Website
https://www.spiedigitallibrary.org/journals/Journal-of-Electronic-Imaging/volume-26/issue-6/060501/Can-we-see-photosynthesis-Magnifying-the-tiny-color-changes-of/10.1117/1.JEI.26.6.060501.short
Research Year
2017
Subscribe to