Biologically Inspired Model for Visual Cognition Achieving Unsupervised Episodic and Semantic Feature Learning.

Recently, many biologically inspired visual computational models have been proposed. The design of these models follows the related biological mechanisms and structures, and these models provide new solutions for visual recognition tasks. In this paper, based on the recent biological evidence, we propose a framework to mimic the active and dynamic learning and recognition process of the primate visual cortex. From principle point of view, the main contributions are that the framework can achieve unsupervised learning of episodic features (including key components and their spatial relations) and semantic features (semantic descriptions of the key components), which support higher level cognition of an object. From performance point of view, the advantages of the framework are as follows: 1) learning episodic features without supervision-for a class of objects without a prior knowledge, the key components, their spatial relations and cover regions can be learned automatically through a deep neural network (DNN); 2) learning semantic features based on episodic features-within the cover regions of the key components, the semantic geometrical values of these components can be computed based on contour detection; 3) forming the general knowledge of a class of objects-the general knowledge of a class of objects can be formed, mainly including the key components, their spatial relations and average semantic values, which is a concise description of the class; and 4) achieving higher level cognition and dynamic updating-for a test image, the model can achieve classification and subclass semantic descriptions. And the test samples with high confidence are selected to dynamically update the whole model. Experiments are conducted on face images, and a good performance is achieved in each layer of the DNN and the semantic description learning process. Furthermore, the model can be generalized to recognition tasks of other objects with learning ability.

Enhanced HMAX model with feedforward feature learning for multiclass categorization.

In recent years, the interdisciplinary research between neuroscience and computer vision has promoted the development in both fields. Many biologically inspired visual models are proposed, and among them, the Hierarchical Max-pooling model (HMAX) is a feedforward model mimicking the structures and functions of V1 to posterior inferotemporal (PIT) layer of the primate visual cortex, which could generate a series of position- and scale- invariant features. However, it could be improved with attention modulation and memory processing, which are two important properties of the primate visual cortex. Thus, in this paper, based on recent biological research on the primate visual cortex, we still mimic the first 100-150 ms of visual cognition to enhance the HMAX model, which mainly focuses on the unsupervised feedforward feature learning process. The main modifications are as follows: (1) To mimic the attention modulation mechanism of V1 layer, a bottom-up saliency map is computed in the S1 layer of the HMAX model, which can support the initial feature extraction for memory processing; (2) To mimic the learning, clustering and short-term memory to long-term memory conversion abilities of V2 and IT, an unsupervised iterative clustering method is used to learn clusters with multiscale middle level patches, which are taken as long-term memory; (3) Inspired by the multiple feature encoding mode of the primate visual cortex, information including color, orientation, and spatial position are encoded in different layers of the HMAX model progressively. By adding a softmax layer at the top of the model, multiclass categorization experiments can be conducted, and the results on Caltech101 show that the enhanced model with a smaller memory size exhibits higher accuracy than the original HMAX model, and could also achieve better accuracy than other unsupervised feature learning methods in multiclass categorization task.

Biologically Inspired Visual Model With Preliminary Cognition and Active Attention Adjustment.

Recently, many computational models have been proposed to simulate visual cognition process. For example, the hierarchical Max-Pooling (HMAX) model was proposed according to the hierarchical and bottom-up structure of V1 to V4 in the ventral pathway of primate visual cortex, which could achieve position- and scale-tolerant recognition. In our previous work, we have introduced memory and association into the HMAX model to simulate visual cognition process. In this paper, we improve our theoretical framework by mimicking a more elaborate structure and function of the primate visual cortex. We will mainly focus on the new formation of memory and association in visual processing under different circumstances as well as preliminary cognition and active adjustment in the inferior temporal cortex, which are absent in the HMAX model. The main contributions of this paper are: 1) in the memory and association part, we apply deep convolutional neural networks to extract various episodic features of the objects since people use different features for object recognition. Moreover, to achieve a fast and robust recognition in the retrieval and association process, different types of features are stored in separated clusters and the feature binding of the same object is stimulated in a loop discharge manner and 2) in the preliminary cognition and active adjustment part, we introduce preliminary cognition to classify different types of objects since distinct neural circuits in a human brain are used for identification of various types of objects. Furthermore, active cognition adjustment of occlusion and orientation is implemented to the model to mimic the top-down effect in human cognition process. Finally, our model is evaluated on two face databases CAS-PEAL-R1 and AR. The results demonstrate that our model exhibits its efficiency on visual recognition process with much lower memory storage requirement and a better performance compared with the traditional purely computational methods.

Crosslinked collagen hydrogels as corneal implants: effects of sterically bulky vs. non-bulky carbodiimides as crosslinkers.

We have previously shown that recombinant human collagen can be crosslinked with N-(3-dimethylaminopropyl)-N'-ethylcarbodiimide (EDC) to fabricate transparent hydrogels possessing the shape and dimensions of the human cornea. These corneal implants have been tested in a Phase I human clinical study. Although these hydrogels successfully promoted corneal tissue and nerve regeneration, the gelling kinetics were difficult to control during the manufacture of the implants. An alternative carbodiimide capable of producing hydrogels of similar characteristics as EDC in terms of strength and biocompatibility, but with a longer gelation time would be a desirable alternative. Here, we compared the crosslinking kinetics and properties of hydrogels crosslinked with a sterically bulky carbodiimide, N-Cyclohexyl-N'-(2-morpholinoethyl) carbodiimide metho-p-toluenesulfonate (CMC), with that of EDC. CMC crosslinking was possible at ambient temperature whereas the EDC reaction was too rapid to control and had to be carried out at low temperatures. The highest tensile strength obtained using optimized formulations were equivalent, although CMC crosslinked hydrogels were found to be stiffer. The collagenase resistance of CMC crosslinked hydrogels was superior to that of EDC crosslinked hydrogels while biocompatibility was similar. We are also able to substitute porcine collagen with recombinant human collagen and show that the in vivo performance of both resulting hydrogels as full-thickness corneal implants is comparable in a mouse model of an orthotopic corneal graft. In conclusion, CMC is a viable alternative to EDC as a crosslinker for collagen-based biomaterials for use as corneal implants, and potentially for use in other tissue engineering applications.

Controlled release of bevacizumab through nanospheres for extended treatment of age-related macular degeneration.

Bevacizumab (Avastin(®)) has been used by ophthalmologists in many countries as an off-label drug for the treatment of wet age-related macular degeneration (AMD). Due to its short half-life necessitating frequent intravitreal injection, a method for sustained delivery is in need. We demonstrated that bevacizumab could be released in a sustained fashion over 90 days from nano- and microspheres fabricated from poly(DL-lactide-co-glycolide) and poly(ethylene glycol)-b-poly(D,L-lactic acid), respectively. The drug release rate could be adjusted by alteration of the drug/polymer ratio. The use of such nano- and microspheres as bevacizumab delivery vehicles may improve the treatment of wet AMD.

A collagen­chitosan hydrogel for endothelial differentiation and angiogenesis.

Cell therapy for the treatment of cardiovascular disease has been hindered by low cell engraftment, poor survival, and inadequate phenotype and function. In this study, we added chitosan to a previously developed injectable collagen matrix, with the aim of improving its properties for cell therapy and neovascularization. Different ratios of collagen and chitosan were mixed and chemically crosslinked to produce hydrogels. Swell and degradation assays showed that chitosan improved the stability of the collagen hydrogel. In culture, endothelial cells formed significantly more vascular-like structures on collagen­chitosan than collagen-only matrix. While the differentiation of circulating progenitor cells to CD31+ cells was equal on all matrices, vascular endothelial-cadherin expression was increased on the collagen­chitosan matrix, suggesting greater maturation of the endothelial cells. In addition, the collagen­chitosan matrix supported a significantly greater number of CD133+ progenitor cells than the collagen-only matrix. In vivo, subcutaneously implanted collagen­chitosan matrices stimulated greater vascular growth and recruited more von Willebrand factor (vWF+) and CXCR4+ endothelial/angiogenic cells than the collagen-only matrix. These results indicate that the addition of chitosan can improve the physical properties of collagen matrices, and enhance their ability to support endothelial cells and angiogenesis for use in cardiovascular tissue engineering applications.

Biosynthetic corneal substitute implantation in dogs.

PURPOSE: To assess integration of a biosynthetic corneal implant in dogs. METHODS: Three normal adult laboratory Beagles underwent ophthalmic examinations, including slit-lamp biomicroscopy, indirect ophthalmoscopy, applanation tonometry, and Cochet-Bonnet aesthesiometry. Biosynthetic corneas fabricated from glutaraldehyde crosslinked collagen and copolymers of collagen and poly(N-isopropylacrylamide-co-acrylic acid-co-acryloxysuccinimide, denoted as TERP) were implanted into dogs by a modified epikeratoplasty technique. Ophthalmic examinations and aesthesiometry were performed daily for 5 days and then weekly thereafter for 16 weeks. Corneal samples underwent histopathological and transmission electron microscopy examination at 16 weeks. RESULTS: Implants were epithelialized by 7 days. Intraocular pressure was within normal range throughout the study. Aesthesiometry values dropped from an average of 3.67 cm preoperatively to less than 1 mm for all dogs for the first postoperative weeks. By week 16, the average Cochet-Bonnet value was 1.67 cm, demonstrating partial recovery of functional innervation of the implant. No inflammation or rejection of the implant occurred, and minimal haze formation was noted. Light microscopy revealed thickened but normal epithelium over the implant with fibroblast migration into the scaffold. On transmission electron microscopy, the basement membrane was irregular but present and adhesion complexes were noted. CONCLUSION: Biosynthetic corneal implantation is well tolerated in dogs, and the collagen-polymer hybrid construct holds promise for clinical application in animals and humans.

Collagen and glycopolymer based hydrogel for potential corneal application.

6-Methacryloyl-alpha-D-galactopyranose (MG) was synthesized, and characterized by Fourier transform infrared (FTIR) and nuclear magnetic resonance (NMR) spectrometry, and single-crystal X-ray diffraction. A series of interpenetrating polymer network (IPN) hydrogels was fabricated by simultaneously photocuring MG crosslinked by poly(ethylene glycol) diacrylate and chemically crosslinking type I collagen with 1-ethyl-3-(3-dimethylaminopropyl) carbodiimide and N-hydroxysuccinimide. The successful incorporation of the glycopolymer, polymer MG, into collagen hydrogel was confirmed by FTIR and solid-state (13)C NMR. The optical characteristics of the IPN hydrogels are comparable to those of human corneas. The tensile strength and modulus of the hydrogels are enhanced by incorporation of polymer MG in comparison to that of the control collagen hydrogel. Biodegradation results indicated that polymer MG enhanced the stability of the composite hydrogels against collagenase. In vitro results demonstrated that the IPN hydrogel supported the adhesion and proliferation of human corneal epithelial cells and outperformed human cornea in blocking bacteria adhesion. Taken together, the IPN hydrogel might be a promising material for use in corneal lamellar keratoplasty.

Synthetic neoglycopolymer-recombinant human collagen hybrids as biomimetic crosslinking agents in corneal tissue engineering.

Saturated neoglycopolymers, prepared via tandem ROMP-hydrogenation (ROMP=ring-opening metathesis polymerization) of carbohydrate-functionalized norbornenes, are investigated as novel collagen crosslinking agents in corneal tissue engineering. The neoglycopolymers were incorporated into recombinant human collagen type III (RHC III) as collagen crosslinking agents and glycosaminoglycan (GAG) mimics. The purely synthetic nature of these composites is designed to reduce susceptibility to immunological and allergic reactions, and to circumvent the transmission of animal infectious diseases. The collagen-neoglycopolymer biomaterials exhibit higher stability to collagenase-induced biodegradation than the control materials, composites of RHC III crosslinked using EDC/NHS (EDC=1-ethyl-3-(3-dimethyl aminopropyl) carbodiimide; NHS=N-hydroxysuccinimide). Even at this proof of concept stage, the thermal stability, enzymatic resistance, and permeability of the neoglycopolymer hydrogels are comparable or superior to those of these fully optimized control materials, which have successfully been tested clinically. Tensile strength is adequate for transplantation, but lower than that of the optimized control materials.

An acellular matrix-bound ligand enhances the mobilization, recruitment and therapeutic effects of circulating progenitor cells in a hindlimb ischemia model.

Circulating progenitor cells home to and engraft to sites of ischemia, mediated in part by the adhesion molecule L-selectin; however, accumulation in tissues such as the heart is low. In this study, an acellular collagen-based matrix containing sialyl Lewis(X) (sLe(X)), which binds L-selectin, was developed in order to enhance the endogenous progenitor cell therapeutic response. Its effect on progenitor cells and angiogenesis were assessed in vitro and using a hindlimb ischemia model with rats. In culture, the sLe(X)-collagen matrix recruited more CD133(+)CD34(+)L-selectin(+) cells than collagen-only matrix, with adhesion mediated by L-selectin binding. Increased angiogenic/chemotactic cytokine production and improved resistance to apoptosis appeared in cells cultured on sLe(X)-collagen matrix. In vivo, mobilization of endogenous circulating progenitor cells was increased, and greater recruitment of these and systemically injected human peripheral blood CXCR4(+)L-selectin(+) cells to sLe(X)-collagen treated limbs was observed compared to collagen-only. This condition was associated with differences in angiogenic/chemotactic cytokine levels, with greater arteriole density and increased perfusion in sLe(X)-collagen treated hindlimbs. With these factors taken together, we demonstrated that an acellular matrix-bound ligand approach can enhance the mobilization, recruitment, and therapeutic effects of endogenous and/or transplanted progenitor cells, possibly through paracrine and antiapoptotic mechanisms, and could be used to improve cell-based regenerative therapies.

Collagen-phosphorylcholine interpenetrating network hydrogels as corneal substitutes.

A biointeractive collagen-phospholipid corneal substitute was fabricated from interpenetrating polymeric networks comprising 1-ethyl-3-(3-dimethyl aminopropyl) carbodiimide and N-hydroxysuccinimide crosslinked porcine atelocollagen, and poly(ethylene glycol) diacrylate crosslinked 2-methacryloyloxyethyl phosphorylcholine (MPC). The resulting hydrogels showed an overall increase in mechanical strength beyond that of either original component and enhanced stability against enzymatic digestion (by collagenase) or UV degradation. More strikingly, these hydrogels retained the full biointeractive, cell friendly properties of collagen in promoting corneal cell and nerve in-growth and regeneration (despite MPC's known anti-adhesive properties). Measurements of refractive indices, white light transmission and backscatter showed the optical properties of collagen-MPC are comparable or superior to those of the human cornea. In addition, the glucose and albumin permeability were comparable to those of human corneas. Twelve-month post-implantation results of collagen-MPC hydrogels into mini-pigs showed regeneration of corneal tissue (epithelium, stroma) as well as the tear film and sensory nerves. We also show that porcine collagen can be substituted with recombinant human collagen, resulting in a fully-synthetic implant that is free from the potential risks of disease transmission (e.g. prions) present in animal source materials.

Surface modification of collagen-based artificial cornea for reduced endothelialization.

Our objective was to develop collagen-based hydrogels as tissue substitutes for corneal transplantation. The design of the full-thickness corneal grafts includes prevention of cell migration onto the posterior surface of the implants, using a plasma-assisted surface modification technique. Briefly, the hydrogel materials were subjected to ammonia plasma functionalization followed by grafting of alginate macromolecules to the target surface. The treated materials surfaces showed observable decreases in endothelial cell attachment. The decrease in cell attachment and adhesion was dependant upon the concentration of alginate and plasma radio frequency (RF) power. High concentrations of alginate 5% (w/v) and high RF power of 100 W produced surfaces with minimal cell attachment. The plasma-alginate treatment did not adversely affect the optical or swelling properties of the constructs. Contact angle measurement analysis revealed that the posterior surface hydrophilicity significantly increased after the treatment. The grafting of alginate to the implants surfaces was confirmed by fourier transform infrared spectroscopy. Both of the untreated and alginate grafted corneal materials were found to be superior to human cornea in optical and swelling properties.

PEG-stabilized carbodiimide crosslinked collagen-chitosan hydrogels for corneal tissue engineering.

Implantable biomaterials that mimic the extracellular matrix (ECM) in key physical and physiological functions require components and microarchitectures that are carefully designed to maintain the correct balance between biofunctional and physical properties. Our goal was to develop hybrid polymer networks (HPN) that combine the bioactive features of natural materials and physical characteristics of synthetic ones to achieve synergy between the desirable mechanical properties of some components with the biological compatibility and physiological relevance of others. In this study, we developed collagen-chitosan composite hydrogels as corneal implants stabilized by either a simple carbodiimide cross-linker or a hybrid cross-linking system comprised of a long-range bi-functional cross-linker (e.g. poly(ethylene glycol) dibutyraldehyde (PEG-DBA)), and short-range amide-type cross-linkers (e.g. 1-ethyl-3-(3-dimethylaminopropyl) carbodiimide (EDC), and N-hydroxysuccinimide (NHS)). Optimum hybrid hydrogel demonstrated significantly enhanced mechanical strength and elasticity by 100 and 20%, respectively, compared to its non-hybrid counterpart. It demonstrated excellent optical properties, optimum mechanical properties and suturability, and good permeability to glucose and albumin. It had excellent biocompatibility and when implanted into pig corneas for 12 months, allowed seamless host-graft integration with successful regeneration of host corneal epithelium, stroma, and nerves.

Alginate microsphere-collagen composite hydrogel for ocular drug delivery and implantation.

A composite collagen hydrogel containing protein encapsulated alginate microspheres was developed for ocular applications. Bovine serum albumin (BSA) served as a drug model. The composite hydrogel retained optical clarity and mechanical robustness of control hydrogels without microspheres. A sustained release of BSA was achieved during an 11-day period in neutral phosphate buffer. The composite hydrogel supported human corneal epithelial cell growth and had adequate mechanical strength and excellent optical clarity for possible use as therapeutic lens for drug delivery and/or use as corneal substitute for transplantation into patients who have corneal diseases.

Tissue-engineered recombinant human collagen-based corneal substitutes for implantation: performance of type I versus type III collagen.

PURPOSE: To compare the efficacies of recombinant human collagens types I and III as corneal substitutes for implantation. METHODS: Recombinant human collagen (13.7%) type I or III was thoroughly mixed with 1-ethyl-3-(3-dimethylaminopropyl)carbodiimide and N-hydroxysuccinimide. The final homogenous solution was either molded into sheets for in vitro studies or into implants with the appropriate corneal dimensions for transplantation into minipigs. Animals with implants were observed for up to 12 months after surgery. Clinical examinations of the cornea included detailed slit lamp biomicroscopy, in vivo confocal microscopy, and fundus examination. Histopathologic examinations were also performed on corneas harvested after 12 months. RESULTS: Both cross-linked recombinant collagens had refractive indices of 1.35, with optical clarity similar to that in human corneas. Their chemical and mechanical properties were similar, although RHC-III implants showed superior optical clarity. Implants into pig corneas over 12 months show comparably stable integration, with regeneration of corneal cells, tear film, and nerves. Optical clarity was also maintained in both implants, as evidenced by fundus examination. CONCLUSIONS: Both RHC-I and -III implants can be safely and stably integrated into host corneas. The simple cross-linking methodology and recombinant source of materials makes them potentially safe and effective future corneal matrix substitutes.

Recombinant human collagen for tissue engineered corneal substitutes.

We successfully fabricated transparent, robust hydrogels as corneal substitutes from concentrated recombinant human type I and type III collagen solutions crosslinked with 1-ethyl-3-(3-dimethyl aminopropyl) carbodiimide (EDC) and N-hydroxysuccinimide (NHS). White light transmission through these gels is comparable or superior to that of human corneas. Hydrogels from both type I and type III collagens supported in vitro epithelium and nerve over-growth. While both these biocompatible hydrogels have adequate tensile strength and elasticity for surgical manipulation, type III collagen hydrogels tended to be mechanically superior. Twelve-month post-implantation results of type I recombinant collagen-based corneal substitutes into mini-pigs showed retention of optical clarity, along with regeneration of corneal cells, nerves and tear film. For clinical use, implants based on fully characterized, recombinant human collagen eliminate the risk of pathogen transfer or xenogeneic immuno-responses posed by animal collagens.

Cellular and nerve regeneration within a biosynthetic extracellular matrix for corneal transplantation.

Our objective was to determine whether key properties of extracellular matrix (ECM) macromolecules can be replicated within tissue-engineered biosynthetic matrices to influence cellular properties and behavior. To achieve this, hydrated collagen and N-isopropylacrylamide copolymer-based ECMs were fabricated and tested on a corneal model. The structural and immunological simplicity of the cornea and importance of its extensive innervation for optimal functioning makes it an ideal test model. In addition, corneal failure is a clinically significant problem. Matrices were therefore designed to have the optical clarity and the proper dimensions, curvature, and biomechanical properties for use as corneal tissue replacements in transplantation. In vitro studies demonstrated that grafting of the laminin adhesion pentapeptide motif, YIGSR, to the hydrogels promoted epithelial stratification and neurite in-growth. Implants into pigs' corneas demonstrated successful in vivo regeneration of host corneal epithelium, stroma, and nerves. In particular, functional nerves were observed to rapidly regenerate in implants. By comparison, nerve regeneration in allograft controls was too slow to be observed during the experimental period, consistent with the behavior of human cornea transplants. Other corneal substitutes have been produced and tested, but here we report an implantable matrix that performs as a physiologically functional tissue substitute and not simply as a prosthetic device. These biosynthetic ECM replacements should have applicability to many areas of tissue engineering and regenerative medicine, especially where nerve function is required.

Bioengineered corneas: how close are we?

Bioengineered corneas are substitutes for human donor tissue that are designed to replace part or the full thickness of damaged or diseased corneas. They range from prosthetic devices that solely address replacement of the cornea's function to tissue-engineered hydrogels that allow some regeneration of the host tissue. In addition, there are also bioengineered lenticules that may be implanted into the cornea to improve vision by altering the refractive properties of the eye, an alternative procedure to refractive surgery. In recent years, there have been significant developments in many areas of bioengineered corneas, such as the clinical trials of an artificial cornea designed as a prosthesis, the development of completely natural corneal replacements, and the development of biosynthetic matrices that permit host tissue regeneration. For correction of refractive errors, a synthetic corneal onlay that allows stable overgrowth of epithelium appears to be promising.

Artificial human corneas: scaffolds for transplantation and host regeneration.

PURPOSE: To review the development of artificial corneas (prostheses and tissue equivalents) for transplantation, and to provide recent updates on our tissue-engineered replacement corneas. METHODS: Modified natural polymers and synthetic polymers were screened for their potential to replace damaged portions of the human cornea or the entire corneal thickness. These polymers, combined with cells derived from each of the three main corneal layers or stem cells, were used to develop artificial corneas. Functional testing was performed in vitro. Trials of biocompatibility and immune and inflammatory reactions were performed by implanting the most promising polymers into rabbit corneas. RESULTS: Collagen-based biopolymers, combined with synthetic crosslinkers or copolymers, formed effective scaffolds for developing prototype artificial corneas that could be used as tissue replacements in the future. We have previously developed an artificial cornea that mimicked key morphologic and functional properties of the human cornea. The addition of synthetic polymers increased its toughness as it retained transparency and low light scattering, making the matrix scaffold more suitable for transplantation. These new composites were implanted into rabbits without causing any acute inflammation or immune response. We have also fabricated full-thickness composites that can be fully sutured. However, the long-term effects of these artificial corneas need to be evaluated. CONCLUSIONS: Novel tissue-engineered corneas that comprise composites of natural and synthetic biopolymers together with corneal cell lines or stem cells will, in the future, replace portions of the cornea that are damaged. Our results provide a basis for the development of both implantable temporary and permanent corneal replacements.