2023 Fiscal Year Research-status Report
Object recognition, localization and private object interaction tracking for maintenance-free IoT
| Project/Area Number |
22K17883
|
|---|
| Research Institution | Osaka University |
|---|
Principal Investigator |
エルデーイ ヴィクトル 大阪大学, 大学院情報科学研究科, 特任助教(常勤) (40850938)
|
|---|
| Project Period (FY) |
2022-04-01 – 2026-03-31
|
| Keywords | Object recognition / wireless sensing / localization / backscatter tags |
|---|
| Outline of Annual Research Achievements |
We addressed reviewers' comments after our paper was rejected by IEEE IoT Journal. We performed additional data collection experiments in order to investigate object recognition performance when using different liquids in bottles, different bottle sizes, and different sensing distances. Clarifications were also made to the text. We plan to resubmit to the same journal as suggested by reviewers.
We proposed a low-cost backscatter tag system for localization, tackling the battery management challenge in RF-based methods using ultra-low-power backscatter tags. It estimates Angle of Arrival and Time of Flight using a receiving antenna array and MUSIC-based algorithm, without needing FPGA or ASIC (application specific circuits) in the backscatter tag. This work contributed to a master's thesis and a published workshop paper on Angle of Arrival estimation.
Building on our localization research, we proposed activity recognition using Wi-Fi CSI and backscatter tags. Backscatter tags can increase the quantity of CSI observations without extra Wi-Fi devices, enhancing accuracy and coverage. Preliminary experiments show high accuracy in distinguishing activities, and combining CSI and CSI backscatter data further improves performance. This work contributed to another master's thesis, titled "Activity Recognition Using CSI Backscatter with Commodity Wi-Fi."
|
| Current Status of Research Progress |
Current Status of Research Progress
2: Research has progressed on the whole more than it was originally planned.
Reason
Based on the details reported in the achievements section, we can say that we have made significant progress in the research. However, we note that the focus of the research has slightly shifted due to new information and results found, the development of the scientific field, and the availability of students for each topic.
|
| Strategy for Future Research Activity |
We hope to resubmit and publish our results on object recognition in the near future. Then, we may shift our focus towards extending the backscatter-based localization work. Regarding localization, potential future directions are as follows. First, we could investigate the feasibility of using Bluetooth backscatter for localization. Second, we could explore the angle of arrival feature provided by Bluetooth 5. Third, we found that it is difficult to use our current backscatter tags to communicate over longer distances (more than a few tens of centimeters). Therefore, we could investigating this issue of limited range, e.g., by monitoring the amplitude and structure of the backscatter signal (reflected by the tag). Fourth, we could explore the feasibility of using backscatter tags for real-world elderly monitoring instead of using BLE/Wi-Fi-based smart home IoT devices (depends on solving the distance issue). Finally, we could also consider a real implementation of a Wi-Fi access point with an additional feature of transmitting simple sine waves designed to aid localization (e.g., by modifying an open-source router firmware).
As we have identified several possible open-ended research directions for the localization work, we may choose to focus on these instead of engaging deeply with the "private object interaction tracking" topic of the original research proposal. Nevertheless, protecting privacy remains to be an important aspect of our research.
|
| Causes of Carryover |
1. The business trip to present our workshop paper at PerCom cost less than originally expected. Additionally, my student traveled instead of me, which further decreased the costs (conference registration was cheaper etc.). A portion of this amount will be used to attend Mobisys 2024 (international conference).
2. We may need to replace our desktop PC (used specifically for experiments) with a newer, more high-spec PC (better CPU, memory, storage, and perhaps GPU) depending on future experimental needs in the object recognition work. To keep this option open, we decided to carry over some amount.
3. We experienced some malfunction with the mobile workstation PC we purchased, but we were able to repair it at a low cost without having to replace it.
4. So far, we have been able to continue working with the existing software versions we have (such as MATLAB). We will renew or buy such licenses when needed.
|
