Atrof-muhitni kuzatish va haqiqiy dunyoda harakat qilish uchun robot turli xil fon yorug'lik sharoitida tasvirlar va atrof-muhit o'lchovlarini olish imkoniyatiga ega bo'lishi kerak. So'nggi yillarda butun dunyo bo'ylab tadqiqotchilar va muhandislar robotlar, kuzatuv tizimlari yoki ularning atrofini sezadigan boshqa qurilmalarga integratsiya qilish uchun tobora ko'proq ilg'or sensorlarni ishlab chiqish ustida ishlamoqda.
Memes Consulting ma'lumotlariga ko'ra, Gonkong politexnika universiteti, Pekin universiteti, Yonsey universiteti va Fudan universiteti tadqiqotchilari yaqinda retinal funktsiyani sun'iy ravishda taqlid qiluvchi va turli xil ma'lumotlarda foydalanish mumkin bo'lgan mexanizmdan foydalanadigan bionik ko'rish sensorining yangi turini ishlab chiqdilar. yorug'lik sharoitida. Ushbu bionik ko'rish sensori molibden disulfididan tayyorlangan fototranzistorlarga asoslangan.
Biomimetik ko'rish sensori majmuasining fotosurati (chapda); ko'rish sensori blokining sxematik tuzilishi va optik mikroskop tasviri (o'ngda)
"Our research team started work on optoelectronic memory five years ago," said Yang Chai, one of the researchers who developed the vision sensor. "This emerging device can output light-dependent and history-dependent signals, enabling image integration. , Weak signal accumulation, spectral analysis and other complex image processing functions, the multi-functional integration of sensing, data storage and data processing into one device."
2018-yilda Yang Chay va uning hamkasblari optoelektronik xotiraga oid birinchi maqolani nashr etishdi, unda yorug‘likni sezish va mantiqiy amallarni bajara oladigan rezistiv kommutatsiya xotira qurilmasini taqdim etishdi. Bir yil o'tgach, jamoa uch xil funktsiyaga ega bo'lgan fotorezistiv tasodifiy kirish xotirasining yangi turini taqdim etdi. Xususan, yangi qurilma atrof-muhitni sezishi, axborotni xotirada saqlashi va neyromorfik vizual qayta ishlash operatsiyalarini bajarishi mumkin.
"We studied the concepts of near-sensor and in-sensor computing paradigms in 2020 and published our views in the field." Yang Chai continued, "This new research on biomimetic vision sensors builds on our On top of all previous efforts."
The intensity of ambient natural light varies widely, with a total range of 280 dB. When the human retina senses external light signals, it adjusts the light sensitivity of its photoreceptors (i.e., rods and cones) according to the strength of the signal. This ultimately enables the human eye to gradually adapt to varying levels of lighting, allowing it to see clearly in both dark and bright environments, an ability known as "visual adaptation."
"For example, when you enter a dark cinema from a bright hall, you can hardly see anything at first, but after a while in the cinema, it becomes easier to see things," explains Yang Chai. "This phenomenon is called scotopic adaptation. Conversely, if you go from a dark movie theater to a sunny outdoors, you'll feel very dazzled at first, and it takes a while to get used to seeing what's going on around you. The process The opposite of dark adaptation is called photopic adaptation."
The main goal of Yang Chai and his colleagues' recent work is to build a vision sensor inspired by the structure and function of the human retina. To do this, they first started by studying the human retina and then tried to design perceptual strategies that would allow them to artificially simulate visual adaptations.
CMOS texnologiyasiga asoslangan zamonaviy tasvir sensorlari-zamonaviy-odatda 70 dB cheklangan dinamik diapazonga ega. Biroq, bu dinamik diapazon tabiiy sahnalarning yorug'lik diapazonidan (280 dB) ancha torroqdir.
"To achieve visual perception over a wide range of light intensities, researchers have explored the use of controlled optical apertures, liquid lenses, adjustable exposure times, and denoising algorithms in post-processing," said Yang Chai. "However, these Methods often require complex hardware and software resources."
Dark and light adaptation of biomimetic vision sensor arrays. (a) Schematic of the dark adaptation test: recognition of low-light images using an 8 x 8 pixel array in a dark environment. (b) Schematic diagram of light adaptation test: recognition of high-illuminance images using an 8 x 8 pixel array in a bright environment. (c) Dark adaptation process to identify the "8" pattern. (d) The photoadaptation process to identify the "8" pattern.
Sensorli terminallarda yorug'lik moslashuvi{0}}ko'rish va keng sezish diapazoniga ega optoelektronik qurilmalar juda qimmatli ilovalarga ega bo'lishi mumkin. Masalan, ular kompyuterni ko'rish vositalarining ish faoliyatini yaxshilashga, robotlar yoki boshqa sezish tizimlarini yaratish uchun zarur bo'lgan apparat murakkabligini kamaytirishga va tasvirni aniqlash tizimlarining aniqligini yaxshilashga yordam beradi.
Garchi boshqa tadqiqot guruhlari o'tmishda turli xil yorug'lik sharoitlariga moslasha oladigan optoelektronik qurilmalarni ishlab chiqdilar. Biroq, ilgari namoyish etilgan qurilmalarning aksariyati faqat retinaning yorug'lik moslashuv mexanizmini taqlid qilishi mumkin. Qorong'i moslashish jarayonini simulyatsiya qilish hozirgacha qiyinroq bo'ldi.
"There is still a long way to go to fully replicate the visual adaptation function of the retina," explains Yang Chai. "To achieve this, we designed a phototransistor-based vision sensor using ultra-thin semiconductors that can The degree of dark adaptation and light adaptation in the same device was controlled by applying different gate voltages. In this way, we simulated photoreceptors and horizontal cells in the retina and successfully achieved a sensing range of 199 dB. Vision-adaptive devices in biomimetic sensors."
Vizual moslashish uchun retinada fotoreseptorlar va gorizontal hujayralarni sun'iy simulyatsiya qilish (qorong'i moslashish va yorug'likka moslashish)
Yang Chay va uning hamkasblari tomonidan ishlab chiqilgan biomimetik ko'rish sensori molibden disulfidi deb nomlanuvchi ultra yupqa yarim o'tkazgich materialdan tayyorlangan fototranzistorlarga asoslangan. Ular ishlatgan fototranzistorlar turli xil eshik kuchlanishlarida kanal ichidagi elektronlarni ushlab turishi yoki chiqarishi mumkin bo'lgan bir nechta zaryad tutqich holatiga ega.
Ultimately, these states allow researchers to dynamically tune the conductance of their devices. This, in turn, allowed them to artificially simulate the dark- and light-adaptive mechanisms of the human retina, thereby expanding the range of their sensor's perception of different lighting conditions.
"Our bionic vision sensor has several advantages and features," said Yang Chai. "First, the visual adaptation function is implemented in a single device, which greatly reduces the footprint. Second, multiple functions can be implemented on a single device. , including light sensing, memory, and processing. Finally, dark and light adaptation under different light intensities can be achieved by controlling its gate voltage."
Yang Chay va uning hamkasblari bionik ko‘rish sensorini bir qator sinovlarda baholadilar va u insonning to‘r pardasi funksiyasini samarali taqlid qilishi va qorong‘u va yorug‘likka moslashishda ajoyib natijalarga erisha olishini aniqladi. Bundan tashqari, u ilgari taklif qilingan yechimlarga nisbatan ancha yuqori sezuvchanlik diapazoniga ega (199 dB).
"Our vision sensor can enrich machine vision functions, reduce hardware complexity, and achieve high image recognition efficiency," said Yang Chai, "All these advantages are available in areas such as autonomous driving, face recognition, and industrial manufacturing in complex lighting environments. great application prospects."
Kelgusi tadqiqotlarda tadqiqotchilar ko‘rish sensori unumdorligini yanada yaxshilashni, shu bilan birga undan sensor massivlaridan iborat-yirik tizimlarni yaratishda foydalanishni rejalashtirmoqda. Ideal holda, ular kengroq ko'rish maydonini ta'minlash uchun ushbu sensorlar majmuasini moslashuvchan yoki yarim sharsimon substratda qurishni xohlashadi.
"One area that needs improvement is the adaptation time of our vision sensor, as it is still not enough to support machine vision applications." Yang Chai added, "Our goal is to reduce the adaptation time to the microsecond level. In addition, the vision sensor array scale Further improvements are also needed. Our near-term target for array size is greater than 100 x 100 pixels. Finally, the heterogeneous integration of vision sensors and post-processing units, including silicon-based control circuits, is a very important step toward practical applications."
GMKJ Technology sog'lom va aqlli yorug'lik manbalari bilan chuqur shug'ullanadi, bozorga UVA UVB UVC LED, infraqizil IR LED VCSEL mahsulotlari va echimlarining to'liq spektrini taqdim etadi. Sog'lom va aqlli hayotni yaratish uchun yorug'lik texnologiyalaridan foydalanishni birgalikda targ'ib qilish uchun ichki va tashqi bozorlarda yuzlab yuqori sifatli-hamkorlarga ega. .
