Drug classification with a spectral barcode obtained with a smartphone Raman spectrometer

Measuring, recording and analyzing spectral information of materials as its unique finger print using a ubiquitous smartphone has been desired by scientists and consumers. We demonstrated it as drug classification by chemical components with smartphone Raman spectrometer. The Raman spectrometer is based on the CMOS image sensor of the smartphone with a periodic array of band pass filters, capturing 2D Raman spectral intensity map, newly defined as spectral barcode in this work. Here we show 11 major components of drugs are classified with high accuracy, 99.0%, with the aid of convolutional neural network (CNN). The beneficial of spectral barcodes is that even brand name of drug is distinguishable and major component of unknown drugs can be identified. Combining spectral barcode with information obtained by red, green and blue (RGB) imaging system or applying image recognition techniques, this inherent property based labeling system will facilitate fundamental research and business opportunities.

Miniaturization of optical spectrometers has been an active area of research because the demand for portable scientific and industrial characterization tools remains high1,2,3,4,5. Furthermore, smartphones are ubiquitous devices that provide numerous applications and services. Recently, many efforts have focused on converting smartphone cameras into optical spectrometers for mobile food inspection6,7 beauty care8, health care9, and other applications10,11,12,13,14. In these cases, the image sensor of the smartphone detects optical signals from the object of interest—such as reflectance, fluorescence, and Raman emissions. Then, the smartphone’s application processor (AP) and communication chip can together perform on-device or cloud-linked analysis12, providing identification of specimens or evaluation of physical or chemical conditions.

Most research on smartphone-based spectrometers uses gratings as a dispersion component, assembled in an external optics module6,7,8,9,10,11,12,13. Gratings is an excellent optical component in spectrometer to disperse optical signals with high spectral resolution, but is not easy to minimize its form factor to fit into smartphone. To overcome this issue, mini spectrometers by replacing conventional grating with such as photonic crystals14,15, metasurfaces16,17,18, quantum dots19 and silicone nanowires20 integrated on charge coupled detector (CCD) or CMOS image sensors have been investigated. To calculate the input spectrum, s(λ)
out of measured intensity, I(x)
at the detector, numerical analysis needs to be done as expressed by the equation below due to its low Q-factor or complicated form of response function, r(λ,x)
at each pixel where x
is the position of each pixel at the detector.

Thus, experimental results in the literature14,15,16,17,18,19,20 have substantial limitations—especially in terms of capturing weak and high spectral resolution required for Raman signatures.

Due to the increasing online pharmacies and supply chain, counterfeit drugs have become threatening even to public health safety. This issue becomes more critical since increasing the online pharmacies and supply chain can provide blind spots for counterfeit or substandard drugs to be distributed into the public health market21. Current smartphone applications (such as DrugID, ID My Pill, Pill Identifier, Pill Finder, and Drug Info) can distinguish drug types and models either by entering the name, shape, color, and/or etched marks of the drugs; or by comparing the drug pill’s RGB images (acquired with the camera) with the U.S. Food and Drug Administration database. The identification accuracy is insufficient due to similar appearance, absence in the database, or other technical issues. In this sense, Raman spectrum can provide valuable information on drugs, and there have been some researches in the literature on classifying drugs by Raman spectroscopy with the aid of machine learning22,23,24,25,26. Classifying pharmaceutical ingredients, and detection of newly emerging psychoactive substance and illicit drugs were demonstrated by partial least squares-discriminate analysis (PLS-DA)22, principal component analysis (PCA)23 and CNN24, respectively. Detection of illicit drugs25 or psychoactive drugs26 were demonstrated even in human urine and finger marks to prevent patients from overdose or misuse of it by support vector machines (SVM) and PLS-DA, respectively.

We demonstrated smartphone based Raman spectrometer which are enough for drug classification. The Raman spectrometer is composed of 2D periodic array of band pass filters on the image sensor of a Samsung Galaxy Note 9, with a compact external Raman module. Raman intensity map captured by the image sensor is defined as Raman spectral barcode by the analogy of conventional barcodes, machine-readable optical labels that enable location, identification, and/or tracking. As a demonstration, we experimentally investigated 54 commonly used drugs for diabetes, hyperlipidemia, hypertension, painkillers, and nutritional supplements; which frequently come in almost identical shapes, sizes, and colors. Since each spectral barcode of drug contains unique Raman signatures of the material, we conducted the identification of spectral barcodes of drugs with a convolutional neural network (CNN) embedded in the smartphone. In addition, identification accuracy can be further enhanced by information fusion with spectral barcode and conventional RGB images taken by the smartphone camera. Another advantage of spectral barcode-based classification is that we can identify chemical component of unknown drugs once other drugs with the same chemical component are in the database.

Integrating with AI capability in the smartphone spectrometer allows users to analyze the spectrum at various places and situations. This will enhance its portability and usability of smartphone spectrometer in numerous disciplines including drug classification. Our proposed concept of a CNN powered spectral barcode will facilitate many research and business opportunities for smartphone spectrometers.

Smartphone Raman spectrometer and spectral barcode
Figure 1 shows schematics of the smartphone Raman spectrometer and spectral barcode; which is the 2D Raman intensity map acquired with the smartphone Raman spectrometer, and an artificial intelligence algorithm embedded in the smart phone for classification. Raman signals are generated and collected by a compact external module integrated with a 785 nm laser diode. The miniaturized external Raman module is attached to the rear-wide camera of the Samsung Galaxy Note 9, and its detailed optical components and configurations is shown in Supplementary Fig. 1 with a photograph. The Raman emission, which is excited by positioning the specimen at the focal point, i.e. contacting at the objective lens, simultaneously illuminates several sets of 128 channels (CHs) located near the center of the image sensor. For 120 CHs out of 128 CHs, its band pass filters transmit 120 distinct wavelengths in the range of 830–910 nm. The rest CHs are blocked by metal as position indicators exhibited as black squares in Fig. 1. The spectral width and transmission rate of the band pass filters range from 1–1.2 nm and 0.45–0.6, respectively (Supplementary Fig. 2). Each band pass filter consisted of a pair of Si/SiO2 distributed Bragg reflectors (DBRs), its resonant wavelength is adjusted by the thickness of the Si cavity layer in the center27,28. The details of the filter structure and fabrication can be found in Methods. In Supplementary Table 1, the smartphone Raman spectrometer of this work is compared with miniaturized spectrometers which are controllable by android smartphones, or embedded in the smartphone12,29,30. The compared details are shown in the caption of Supplementary Table 1. As the role of the external module in this work is just to excite and collect Raman signals from the specimen without additional connecting electronic board to the smartphone, the smartphone Raman spectrometer becomes more compact and versatile with minimized external module.

Posted in Uncategorized | Comments Off on Drug classification with a spectral barcode obtained with a smartphone Raman spectrometer

Telemarketing – Top Reasons to Outsource Telesales to an Outbound Call Center Service Provider

The decision to outsource telemarketing services depends on a number of factors, the most important of which is whether the benefits accrued outweigh the costs incurred. It is the foremost duty of management to analyze the cost-benefit ratio before going in for outsourcing. This article weighs various criteria that may help make that decision.

The primary benefits that come with outsourcing are the expenditure spared in recruiting and maintaining an entire telemarketing staff and the costs saved in procuring the equipment. The payroll costs are in part passed on as charges for the telemarketing services but the added benefits depend on how expensive the locally available labor is. If very low-cost labor is locally available to a company,Telemarketing – Top Reasons to Outsource Telesales to an Outbound Call Center Service Provider Articles outsourcing may not help save much on this count. As regards the equipment, the seasonal telemarketers are more likely to find outsourcing more efficient rather than the ones who need telemarketing services throughout the year.

However, once the initial costs are taken care of, outsourcing does contribute to saving costs for the company in the long run. Here are a few important reasons why you should go in for outsourcing:

Hiring of personnel

Labor costs are only a small part of the entire expenses that come along with hiring staff for the telemarketing services. The hiring and recruitment of the personnel can prove to be an expensive and cumbersome affair for the management. The money spent on the recruitment agencies and the time spent by management in interviewing the candidates is hardly worth the effort.

At times, the company may be forced to manage with a leaner staff than is actually required and compromise on the opportunity costs in not being able to make enough telemarketing calls due to shortage of staff. Outsourcing the services will not only ensure a well-staffed team to make the required number of telemarketing calls but also help tackle all the problems related to the recruitment of the personnel.

Professional training

Providing appropriate training to the personnel is perhaps, more important than hiring them because it is the kind of training that will determine the quality and success rate of telemarketing calls. Here again, businesses cannot afford to cut costs by compromising with a less professionally trained staff. The company and its products have to be represented by well-trained professionals.

But it is not at all an easy job to design and implement a high-level training program for telemarketing staff with up-to-date techniques by a company whose primary focus lies elsewhere. Professional telemarketing companies, on the other hand, can distribute their cost of training between various clients it offers services. As they specialize in telemarketing services, they can afford to spend time and money on providing intensive professional training to the telemarketing callers.

Compliance to telemarketing rules

With rapidly tightening rules and regulations, telemarketing calls have to comply with the updated restrictions put on these calls by various regional and federal governments. As the rules of various states keep changing from time to time, it gets very confusing for organizations to keep track of them.

In such a situation, it becomes tough for businesses to deal with these legal issues. For specialized telemarketing companies, however, it is a crucial part of their job to ascertain adherence to these rules.

Space for operation

The establishment of an in-house telemarketing facility would mean that the telemarketing staff and equipment would use up good part of the office space while in case of a telemarketing company the cost of space can again be spread among the various clients. A business might be compelled to go in for unnecessary space expansion to accommodate the telemarketing paraphernalia. Outsourcing can help avoid such extra expenditure.

Thus, outsourcing telemarketing services can sav

Posted in Uncategorized | Comments Off on Telemarketing – Top Reasons to Outsource Telesales to an Outbound Call Center Service Provider