2021 Fiscal Year Research-status Report
Passive system for sensing object motion in 3D
| Project/Area Number |
20K04516
|
|---|
| Research Institution | Utsunomiya University |
|---|
Principal Investigator |
ヘーガン ネイザン 宇都宮大学, 工学部, 准教授 (50781506)
|
|---|
| Project Period (FY) |
2020-04-01 – 2023-03-31
|
| Keywords | 3次元形状計測 / スナップショット |
|---|
| Outline of Annual Research Achievements |
In the past year, I have guided an undergraduate student through this research, and we have successfully demonstrated a proof of concept measurement of simultaneous spectrum and depth imaging --- that is, an (x,y,z,lambda) 4-dimensional dataset. We showed that we can generate a field of sinusoidal fringes that shift laterally as a function of wavelength. Therefore, if we capture a sequence of four wavelength bands, then we get four shifted fringe fields and reconstruct the fringe phase, and therefore the object height, from the spectrally-resolved images. In addition, since we have an excess of wavelength resolution in our system --- about 32 wavelength bands across the visible spectral range --- we can use four wavelength bands to estimate the z-height of the surface and use the other wavelength bands to measure the surface's reflectance spectrum, increase the dynamic range, improve algorithm robustness, etc.
So far, we have demonstrated our ability to do this using an electronically tunable spectral filter and camera. This year, we plan to calibrate my lab's snapshot imaging spectrometer and adapt it for use with the front-end projection system which we have already built. This should allow for full snapshot operation.
I have published three journal papers so far, with another three papers currently under review, plus several conference proceedings articles, under this project's support.
|
| Current Status of Research Progress |
Current Status of Research Progress
3: Progress in research has been slightly delayed.
Reason
As a result of the coronavirus situation, I got a late start on the research project, from the start. I had also hoped to spend the past year working closely with a PhD graduate student on the project, but he was unable to travel to Japan, despite being accepted into the PhD program, until this week.
Kakenhi recommends that, as far as possible, recipients of research funds should try to use them to support students with research assistantships. Towards that goal, I plan to use almost all of my research funds in the coming year towards funding the PhD student, and is scheduled to start on the research project in the coming week. This is a student who is not supported by a government scholarship, but is energetic and enthusiastic.
|
| Strategy for Future Research Activity |
My plan for the next year is to refine the depth-estimation algorithm to improve the depth-measurement precision, and to demonstrate the other strengths obtained by combining spectrum with depth, such as allowing achieving high dynamic range, allowing objects with spectrally-varying reflectance, and improved-robustness phase unwrapping. I also plan to measure the effect of different sample types (smooth vs. rough, light vs. dark) on measurement accuracy, the effect on depth measurement of different choices of lenses, and what is the best tradeoff between spatial resolution and spectral resolution.
Once the snapshot system is assembled, I plan to do a series of experiments on dynamic scenes (such as using a camera lens to measure cars driving on the road, a macro lens to show a beetle walking across the ground, a microscope to show motion of tiny organisms). Finally, I also plan to explore algorithmic approaches to expanding on the capabilities of the system. For example, by interpolating over the time domain of the video data, it should be possible to increase the distance resolving power of the system.
|
| Causes of Carryover |
Kakenhi recommends that, as far as possible, recipients of research funds should try to use them to support students with research assistantships. Towards that goal, I plan to use almost all of my research funds in the coming year towards funding a PhD student that has just joined my lab this past year. He has not yet been able to come to Japan due to coronavirus restrictions, but just arrived in Japan this past week and is scheduled to start on the research project in the coming week.
In the past two years I have succeeded in purchasing the necessary equipment for the research, so that if there are no unexpected needs, I should have no difficulty in completing the project despite redirecting funding to personnel costs.
|
