This is where AI will improve in 2021

Logistics Transportation Review | Friday, January 07, 2022

Artificial intelligence continues to advance at a rapid pace. Even in 2020, a year that did not lack compelling news, AI advances commanded mainstream attention on multiple occasions. OpenAI’s GPT-3, in particular, showed new and surprising ways we may soon be seeing AI penetrate daily life. Such rapid progress makes predictions about the future of AI somewhat difficult, but some areas do seem ripe for breakthroughs. Here are a few areas in AI that we feel particularly optimistic about in 2021.

FREMONT, CA: Two of 2020’s biggest AI achievements quietly shared the same underlying AI structure. Both OpenAI’s GPT-3 and DeepMind’s AlphaFold are based on a sequence processing model called the Transformer. Although Transformer structures have been around since 2017, GPT-3 and Alphafold demonstrated the Transformers remarkable ability to learn more deeply and quickly than the previous generation of sequence models and to perform well on problems outside of natural language processing.

Unlike prior sequence modeling structures such as recurrent neural networks and LSTMs, Transformers depart from the paradigm of processing data sequentially. They process the whole input sequence at once, using a mechanism called attention to learn what parts of the input are relevant in relation to other parts. This allows Transformers to easily relate distant parts of the input sequence, a task that recurrent models have famously struggled with. It also allows significant parts of the training to be done in parallel, better leveraging the massively parallel hardware that has become available in recent years and greatly reducing training time. Researchers will undoubtedly be looking for new places to apply this promising structure in 2021, and there’s good reason to expect positive results. In fact, in 2021 OpenAI has already modified GPT-3 to generate images from text descriptions. The transformer looks ready to dominate 2021.

Stay ahead of the industry with exclusive feature stories on the top companies, expert insights and the latest news delivered straight to your inbox. Subscribe today.

Graph neural networks

Many domains have data that naturally lend themselves to graph structures: computer networks, social networks, molecules/proteins, and transportation routes are just a few examples. Graph neural networks (GNNs) enable the application of deep learning to graph-structured data, and we expected GNNs to become an increasingly important AI method in the future. More specifically, in 2021, we expect that methodological advances in a few key areas will drive broader adoption of GNNs.

Dynamic graphs are the first area of importance. While most GNN research to date has assumed a static, unchanging graph, the scenarios above necessarily involve changes over time: For example, in social networks, members join (new nodes) and friendships change (different edges). In 2020, we saw some efforts to model time-evolving graphs as a series of snapshots, but 2021 will extend this nascent research direction with a focus on approaches that model a dynamic graph as a continuous time series. Such continuous modeling should enable GNNs to discover and learn from the temporal structure in graphs in addition to the usual topological structure.

Improvements on the message-passing paradigm will be another enabling advancement. A common method of implementing graph neural networks, message passing is a means of aggregating information about nodes by “passing” information along the edges that connect neighbors. Although intuitive, message passing struggles to capture effects that require information to propagate across long distances on a graph. Next year, we expect breakthroughs to move beyond this paradigm, such as by iteratively learning which information propagation pathways are the most relevant or even learning an entirely novel causal graph on a relational dataset.

Applications

Many of last year’s top stories highlighted nascent advances in practical applications of AI, and 2021 looks poised to capitalize on these advances. Applications that depend on natural language understanding, in particular, are likely to see advances as access to the GPT-3 API becomes more available. The API allows users to access GPT-3’s abilities without requiring them to train their own AI, an otherwise expensive endeavor. With Microsoft’s purchase of the GPT-3 license, we may also see the technology appear in Microsoft products as well.

Other application areas also appear likely to benefit substantially from AI technology in 2021. AI and machine learning (ML) have spiraled into the cybersecurity space, but 2021 shows the potential of pushing the trajectory a little steeper. As highlighted by the SolarWinds breach, companies are coming to terms with impending threats from cybercriminals and nation-state actors and the constantly evolving configurations of malware and ransomware. In 2021, we expect an aggressive push of advanced behavioral analytics AI for augmenting network defense systems. AI and behavioral analytics are critical to helping identify new threats, including variants of earlier threats.

We also expect an uptick in applications defaulting to running machine learning models on edge devices in 2021. Devices like Google’s Coral, which features an onboard tensor processing unit (TPU), are bound to become more widespread with advancements in processing power and quantization technologies. Edge AI eliminates the need to send data to the cloud for inference, saving bandwidth and reducing execution time, both of which are critical in fields such as health care. Edge computing may also open new applications in other areas that require privacy, security, low latency, and in regions of the world that lack access to high-speed internet.

Check Out This : Solar Energy Services Companies

The bottom line

AI technology continues to proliferate in practical domains, and advances in Transformer structures and GNNs are likely to spur advances in domains that haven’t yet readily lent themselves to existing AI techniques and algorithms. We’ve highlighted here several areas that seem ready for advancement this year, but there will undoubtedly be surprises as the year unfolds. Predictions are hard, especially about the future, as the saying goes, but right or wrong, 2021 looks to be an exciting year for the field of AI.

More in News

 Following the regulations set by the U.S. Department of Transportation (DOT) is essential for ensuring safety, efficiency, and reliability in logistics operations. These regulations cover a wide range of requirements, including driver qualifications, vehicle safety standards, hazardous materials handling, and compliance with hours-of-service (HOS) rules. Failure to meet these standards can expose logistics companies to significant operational, financial, and legal risks. The most immediate consequences of noncompliance often include hefty fines and the possibility of legal action. Violations related to vehicle maintenance, driver qualifications, and hours of service (HOS) limits can lead to substantial fines for logistics companies. Repeated or severe violations can result in even more severe penalties, such as suspending or revoking a company’s operating authority. It effectively shuts down a logistics business, preventing it from conducting operations until compliance issues. The financial burden of these penalties and lost business opportunities can overwhelm logistics companies, particularly small or medium-sized businesses. Another significant economic impact of non-compliance with DOT regulations is increased insurance premiums. Failing to meet DOT compliance can lead to significant operational disruptions, negatively affecting the entire logistics supply chain. Non-compliant vehicles may be pulled from service for inspections, repairs, or even impounded, causing delivery delays. These disruptions can lead to missed deadlines, damaged customer relationships, and a loss of business credibility. For example, if a truck is found non-compliant during a routine roadside inspection, it could be placed out of service, stranding goods and customers waiting. Driver non-compliance can cause operational challenges. It can result in a shortage of available drivers, leading to delayed shipments and decreased productivity. A poor safety record, frequent vehicle breakdowns, or accidents can quickly erode customer trust. Failing to meet DOT compliance impacts day-to-day operations and tarnishes a company’s reputation. The most critical consequence of failing to meet DOT compliance is the increased risk of accidents and safety hazards. If drivers exceed HOS limits and become fatigued, their ability to operate vehicles safely is compromised, increasing the risk of collisions. Accidents result in injuries or fatalities, leading to costly legal battles, higher insurance premiums, and further damage to a company’s reputation. Failing to meet DOT compliance can result in losing a competitive edge in the logistics industry. ...Read more
The freight brokerage industry is positioned effectively between the logistics and technology domains, which determine the movement of goods within global markets. With a desire for increased efficiency and transparency, companies are pushing hard for digital transformation across all facets of modern freight operations. Traditional brokerage models mainly depended on human coordination and personal relationships. These are rapidly being replaced by data-driven, measurable solutions that enhance visibility, accuracy, and service delivery. One would no longer mention technology as complementary; such has become the very catalyst of competition and prosperity for the freight brokerage industry. Enhancing Visibility and Decision-Making Among the changes brought about by technology in freight brokerage, the visible data are rapidly transforming the situation. Digital platforms enable real-time tracking, providing logistics managers and shippers with live information on the location, expected arrival time, and performance of the routes. This visibility fosters customer trust while enabling brokers to track and mitigate cost and service delays. As brokers become more familiar with analytical tools for predictive purposes, the focus shifts toward demand anticipation, disruption assessment, and adjustments to routing or pricing strategies. Granting freight brokers access to large amounts of varied data and enabling them to interpret it can fine-tune operational precision, making companies more reliable in serving their long-term clientele. Streamlining Operations through Automation The ultimate trigger for redefining the operational foundation of the freight brokerage has been the advent of automation. A substantial portion of the manual work involved in transactions, such as load matching, rate negotiation, and documentation, has become digital. Real-time matching of shipments with carriers is achieved through automated systems that utilize live capacity, price, and routing optimization data. This significantly shortens turnaround times, thereby enhancing efficiency, as brokers can almost simultaneously redirect their focus to other strategic activities, such as managing relationships and developing their business. The laid-back approach consistently reduces error levels in invoicing, documentation, and other operational areas. On the other hand, this ensures the smooth flow of funds and operational consistency. As technology advances, it is only a matter of time before automation continues to be the catalyst for scaling up and cost-effectively executing freight brokerage operations. Integrating Innovation for Sustainable Growth In addition to efficiency, the integration is setting the stage for freight brokerage models that should grow sustainably and be adaptable. Cloud-based systems offer brokers a unique opportunity to collaborate cross-geographically, providing seamless communication among shippers, carriers, and logistics partners. It is also worth noting that machine learning and artificial intelligence innovations are enabling dynamic price modeling based on real-time market information, enabling brokers to remain competitive while remaining profitable. Sustainability is increasingly core, backed by data-driven tools that measure and support brokers in reducing emissions through optimized route planning and load consolidation. As regulatory and environmental expectations continue to grow, brokers who leverage technology to align profitability and sustainability will be best positioned for long-term success. In essence, technology has been transforming freight brokerage from a coordination-based service to an intelligence-driven operation. This is enabled by the fusion of data analytics, automation, and digital connectivity that will allow brokers to offer a speedy, reliable service with complete transparency. The forward-looking competitive landscape of the logistics industry will be shaped by those who accept innovation, consolidating their market presence to drive the next-generation freight management. ...Read more
The logistics industry is undergoing a significant transformation, driven by the growing demand for customized solutions that cater to the specific needs of different types of goods. Unlike traditional logistics, which deals with general freight, specialized logistics focuses on the transportation of sensitive, high-value, or complex items that require careful handling and strict compliance with regulations. Industries such as healthcare, aerospace, technology, and manufacturing are increasing the demand for these specialized services, as they depend on the timely and secure movement of products like pharmaceuticals, heavy machinery, and electronics. Shifting Market Forces Shaping Specialized Logistics The specialized logistics sector is evolving in response to the growing intricacy of global trade and the heightened demand for customized transportation solutions. Unlike standard freight services, specialized logistics caters to cargo that requires precise handling, monitoring, or conditions, such as pharmaceuticals, hazardous materials, oversized equipment, or high-value electronics. The growing reliance on time-sensitive supply chains and the global expansion of industries like life sciences, aerospace, and technology are accelerating the demand for logistics providers that offer niche expertise and infrastructure tailored to specific cargo requirements. Market forces indicate a clear shift toward integrated, technology-enabled logistics networks that ensure reliability, traceability, and compliance. Digitalization has become a cornerstone of modern specialized logistics operations, with providers investing in data-driven systems that allow real-time tracking, condition monitoring, and predictive maintenance. The rise of cross-border e-commerce and stringent international regulations also adds to the necessity for specialized solutions, encouraging providers to develop end-to-end visibility and control across every supply chain node. Sustainability considerations shape the sector’s future as clients increasingly favor partners that reduce environmental impact through optimized routing, cleaner transportation modes, and eco-friendly packaging. Addressing Operational Hurdles Through Innovation Operating within the specialized logistics space presents a unique set of operational hurdles, yet providers are developing robust solutions to meet these challenges. One key complexity lies in maintaining strict environmental conditions for temperature-sensitive goods, such as biologics or chemical compounds. These shipments must be transported under stable, controlled environments to ensure efficacy and compliance with regulatory standards. Logistics providers are deploying refrigerated transport units with advanced sensors and IoT-enabled monitoring systems to address this. These technologies provide constant feedback on cargo conditions and trigger alerts in the event of anomalies, ensuring swift corrective actions. Another operational barrier involves transporting oversized or high-value equipment, often requiring customized packaging, specialized vehicles, and security protocols. This challenge is met with the integration of route optimization tools, digital load planning, and risk analysis software that anticipate potential disruptions and provide contingency measures. Logistics providers have developed close coordination mechanisms with local authorities to facilitate transport permits and escort arrangements where needed. Navigating international regulations presents another layer of complexity. Each region has unique customs procedures, safety standards, and documentation requirements. Top providers have implemented automated compliance systems to streamline operations and maintain dedicated regulatory teams. These measures significantly reduce clearance times and the risk of non-compliance penalties. Talent and skills gaps within the sector are also being addressed through structured training programs and certification modules. Many providers utilize simulation-based training, augmented reality tools, and scenario-based assessments to prepare personnel for real-world challenges. This proactive approach ensures operational excellence and minimizes errors during critical handling stages. Urban congestion and last-mile delivery bottlenecks are recurring issues in dense population zones. Providers have begun deploying micro-distribution centers strategically placed near demand clusters. This networked approach, supported by electric vehicles and automated parcel sorting, enables swift and sustainable deliveries even in constrained urban environments. Unlocking Strategic Value Through Advancement The specialized logistics landscape presents abundant opportunities for advancement, benefiting stakeholders through improved efficiency, scalability, and value-added services. Integrating artificial intelligence and machine learning reshapes how providers forecast demand, allocate resources, and respond to disruptions. These technologies analyze historical data, customer behavior, and market trends to generate accurate forecasts and enable agile decision-making across logistics operations. Blockchain technology is another notable advancement driving trust and transparency. Blockchain ensures data integrity and enhances stakeholder accountability by recording transactions and movements on a decentralized ledger. This is particularly useful in sectors requiring stringent documentation and traceability, such as pharmaceuticals or defense-related shipments. Smart contracts embedded in blockchain systems also streamline administrative processes, eliminating delays caused by paperwork or manual verification. The emergence of digital twins has opened new avenues for optimization. Providers can simulate various supply chain scenarios, identify weaknesses, and preemptively implement improvements. This innovation enhances the reliability of logistics operations and contributes to cost savings by reducing the risk of delays, damages, or equipment failures. Automation within warehousing and transport systems has also delivered tangible benefits. Robotic arms, automated guided vehicles, and drone-based inventory tracking reduce manual labor dependencies and increase operational throughput. This translates to faster turnaround times, enhanced service quality, and more consistent delivery performance for stakeholders. Integrating AI-powered route planning and real-time fleet management software ensures that high-priority or sensitive deliveries are completed with precision and timeliness. Collaboration between logistics providers, manufacturers, regulatory agencies, and technology partners has driven innovation. These partnerships enable shared knowledge, synchronized standards, and cohesive logistics strategies tailored to complex cargo requirements. Stakeholders benefit from increased resilience, data-sharing capabilities, and a harmonized risk management and compliance approach. Sustainability initiatives in specialized logistics are also gaining momentum, with long-term benefits for clients, communities, and the environment. Providers are transitioning to electric fleets, using biofuels in heavy transport, and investing in carbon offset programs. Advanced analytics help identify emissions hotspots and suggest efficiency improvements in routing and packaging. ...Read more
In the context of natural disasters and catastrophic events, logistics is crucial for effective disaster relief operations. It ensures that essential supplies reach affected areas efficiently and helps coordinate rescue efforts. The ability to respond quickly and decisively can significantly reduce human suffering and save lives. As disasters become more frequent and severe due to climate change and urbanization, understanding the intricacies of disaster relief logistics is increasingly important. Disaster relief logistics is a multifaceted process that begins with a comprehensive needs assessment to determine the extent of the crisis. This involves gathering data on the number of affected individuals, the severity of the disaster, geographical constraints, and the availability of local resources. Effective supply chain management is crucial, encompassing procurement, transportation, warehousing, and distribution to ensure the timely delivery of essential supplies such as food, water, medical aid, and shelter materials. Transportation and delivery play a critical role, particularly in reaching remote or infrastructure-damaged areas, often requiring a combination of air, land, and sea routes to navigate logistical challenges. Coordination and communication among multiple stakeholders—including governments, NGOs, military forces, and private sector partners—are essential to streamline efforts, prevent duplication, and optimize resource allocation. Finally, infrastructure and technology enhance logistical efficiency through innovations such as drones for delivering medical supplies, GPS tracking for precise routing, and data analytics for real-time decision-making. These components form a cohesive system that ensures effective disaster response and relief distribution. Integrating advanced technologies and strategic partnerships is transforming disaster response and logistics. Artificial intelligence (AI) and machine learning enhance predictive capabilities, allowing organizations to assess potential disaster impacts and optimize supply chain operations. Machine learning algorithms refine response strategies by analyzing historical data, improving efficiency. Blockchain technology is leveraged to enhance transparency and accountability in relief operations, ensuring that funds and resources are securely tracked from donors to beneficiaries. Meanwhile, renewable energy solutions, such as solar panels, are increasingly deployed to power temporary shelters, hospitals, and communication networks, reducing reliance on conventional energy sources in crises. Additionally, collaborations with the private sector are expanding as businesses contribute expertise and resources, including warehousing and transportation, to strengthen disaster logistics and response efforts. Enhancing logistics in disaster relief requires a multifaceted approach that prioritizes preparedness, technological integration, community engagement, and sustainability. Pre-positioning critical supplies and ensuring adequately trained personnel can significantly reduce response times, enabling more efficient aid delivery. Integrating emerging technologies like artificial intelligence and robotics can further streamline operations, optimizing resource allocation and distribution. Engaging local communities in planning and decision-making is essential to aligning logistical efforts with actual needs, fostering a more effective and responsive relief framework. Additionally, adopting sustainable practices—such as utilizing renewable energy sources and biodegradable materials—can minimize the environmental impact of disaster response efforts, ensuring long-term resilience and responsible resource management. Effective logistics is at the heart of successful disaster relief operations. While challenges exist, technological innovations and better coordination among stakeholders pave the way for more efficient responses to disasters. As the frequency of disasters increases, a proactive and well-organized approach to logistics will remain indispensable in saving lives and reducing human suffering. ...Read more