Research of ReLU output device in ternary optical computer based on parallel fully connected layer.
Saved in:
| Title: | Research of ReLU output device in ternary optical computer based on parallel fully connected layer. |
|---|---|
| Authors: | Song, Kai1 (AUTHOR) skpark@163.com, Ma, Huaqiong1 (AUTHOR), Zhang, Haiming1 (AUTHOR), Yan, Liping2 (AUTHOR) |
| Source: | Journal of Supercomputing. Apr2024, Vol. 80 Issue 6, p7269-7292. 24p. |
| Subjects: | Parallel computers, Optical devices, Computers, Judgment (Psychology) |
| Abstract: | When implementing fully connected layer computation on electronic computer (EC), slow computing speed and high power consumption result in the inefficiency of the overall process. The ternary optical computer (TOC) platform with enormous data bits and reconfigurable processor can solve the inefficiency of full-connection computation on EC. In this paper, we design the parallel scheme of fully connected layer operations based on TOC and the rectified linear unit (ReLU) output device to achieve the computation of nonlinear fully connected layer. Furthermore, we also use the ReLU output device and the positive and negative discriminator of modified signed digit (MSD) data to design the ReLU judgment output device, which can realize the operation of the ReLU activation function in one step. The operations of the nonlinear fully connected layer with ReLU function on TOC can reduce the amount of computation by one magnitude and have lower power consumption by experimentally verifying the accuracy of operations and analyzing hardware resources and clock cycles. Through comparison find that TOC consumes fewer data bits, while improving the calculation speed by approximately 10%. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Supercomputing is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | When implementing fully connected layer computation on electronic computer (EC), slow computing speed and high power consumption result in the inefficiency of the overall process. The ternary optical computer (TOC) platform with enormous data bits and reconfigurable processor can solve the inefficiency of full-connection computation on EC. In this paper, we design the parallel scheme of fully connected layer operations based on TOC and the rectified linear unit (ReLU) output device to achieve the computation of nonlinear fully connected layer. Furthermore, we also use the ReLU output device and the positive and negative discriminator of modified signed digit (MSD) data to design the ReLU judgment output device, which can realize the operation of the ReLU activation function in one step. The operations of the nonlinear fully connected layer with ReLU function on TOC can reduce the amount of computation by one magnitude and have lower power consumption by experimentally verifying the accuracy of operations and analyzing hardware resources and clock cycles. Through comparison find that TOC consumes fewer data bits, while improving the calculation speed by approximately 10%. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 09208542 |
| DOI: | 10.1007/s11227-023-05737-8 |
