Sushen Zhang's research while affiliated with University of Cambridge and other places

Publications (4)

Article
Full-text available
This article proposes a novel method to optimise the Dynamic Architecture Neural Network (DAN2) adapted for a multi-task learning problem. The multi-task learning neural network adopts a multi-head and serial architecture with DAN2 layers acting as the basic subroutine. Adopting a dynamic architecture, the layers are added consecutively starting fr...
Article
Full-text available
Industry 4.0 aims to transform chemical and biochemical processes into intelligent systems via the integration of digital components with the actual physical units involved. This process can be thought of as the addition of a central nervous system with a sensing and control monitoring of components and regulating the performance of the individual...
Thesis
The design of deep neural networks (DNNs) involves the explicit definition of network architecture as well as the training of the network weights. Each process can be formulated into an optimisation algorithm and can be investigated with regard to optimisation performance. The training of the network weights is defined as a minimisation of the obje...
Article
This paper presents a novel optimisation method, termed Hessian-free Gradient Flow, for the optimisation of deep neural networks. The algorithm entails the design characteristics of the Truncated Newton, Conjugate Gradient and Gradient Flow method. It employs a finite difference approximation scheme to make the algorithm Hessian-free and makes use...

Citations

... e primary concern is data; in natural language processing, it is the corpus [25]. Second, corpus must be carefully screened in terms of quality and data scale to ensure that the results generated have sufficient accuracy [26]. Due to the large capacity of computer storage, authentic text data, and fast and accurate information extraction, linguists can use the electronic corpus to describe language from multiple angles and levels, verify various language theories and hypotheses, and even establish new language models and language concept. ...